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ABSTRACT 

The gap in the available information on the state of 
American Education is discussed- This inadequacy is traced to two 
causes: (1} Data are not organi;;:ed in ways that would facilitate 
policy formation and (2) Data are scattered among a variety of 
agencies- Formulating effective public policy for the support of 
€!lementary and secondary education requires a knowledge of (1) the 
demand for various kinds of educational services, (2) estimates of 
the costs of those demands, (3) a conception of equity in the 
distribution of educational services and of the costs of those 
services, and (4) a continuous monitoring and evaluation of the 
financial and educational impact of federal programs in particular, 
and of American education more generally. To develop recommendations 
for improving the availability of information to those interested in 
questions of educational finance policy, the availability and 
usefulness of information on the important information on the 
nation's educational agenda were examined and catalogued through 
interviews, questionnaires, and staff analysis. The results of this 
research indicate that the present system of educational information 
fails to serve the requirements of those who need timely, reliable, 
and relevant information about the nation's educational problems. It 
is recommended that the Office of Education produce this information 
(For related document, see ED 0 58 473.) (Author/CK) 
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CHAPTER I 



INFORMATION FOR EDUCATIONAL POLICY MAKING : 
A NATIONAL PROBLEM 



American public schools — elementai 7 and secondary — are directed 
and financed through a complex web of relationships that Intermingles 
local, state, and federal levels of government; public and private 
agencies; non-profit and profit-making enterprises; university and 
religious institutions; professional educators and private citizens. 
Picking one's way through this labyrinthine system is an immensely 
challenging undertaking, for few maps are available to assist those 
charged with formulating educational policy. Indeed, what guidelines 
do exist are often more misleading than helpful. Signposts along the 
way labeled "Local control of education," "lay direction of 
professionals," and "the apector of federal control" have become- symbols 
for myopic myths that oversimplify the complex relationships through 
which public education in the United States is governed and supported. 
Such symbols act as deterrents to understanding the over riding policy 
issues in education about which basic decisions must be made. 

Financing of public elementary and secondary education for the 
nation as a whole is approximately 52 percent local, 41 percent state. 



and 7 percent federal, but there Is great variation In these proportions 
among the districts of a state and between the states of the nation 
despite statutory categories, the Intentions of the United States Office 
of Education, and of state education departments. The source of funding 
is often operationally irrelevant to resourceful school district 
superintendents . 

Administrative control over various aspects of school activities 
is similarly difficult to disentangle. Eor example, while curriculum 
determination is one of the mandated responsiolllties of state and 
local education agencies, the impact of decisions by text book 
manufacturing companies or state teachers colleges tends to be far more 
Influential than that of the officially designated governing boards. 

While understanding the workings of this delicate balance, between 

i 

j ■ 

centralization and decentralization, homogeneity and heterogeneity, 
public and private interests, citizen group and professional organiza- 
tions may be exceedingly difficult, it is, we believe, crucial. 
Substantial Improvements in education and further movement toward equal 
educational opportunity can come only from those who grasp both the 
problems and the opportunities that lie burled in the intricate system 
of American public schooling. 

In recent years, the Federal government has begun to' play a 
significant role in American education. As a major recent study of the 
administration of new Federal programs puts it: 

In the scant period of 13 years (1954-67), however, a 

change has occurred. The Federal government's Interest in 
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stimulating change and improving quality in public education 
at the pre-colleglate level has been Increasingly visible in 
four fields; (1) desegregation; (2) education related to 
defense and to vocations; (3) aid to research; and 
(4) education of the economically and culturally disadvantaged, 
and of the handicapped. Federal activity — judicial, legislative, 
and executive — in these four areas has unquestionably affected 
the traditional, decentralized autonomies of American education. 
This is especially true when one adds the fact that Federal 
aid to parochial school children was an Important corollary, 
even a precondition, of many of these new Federal thrusts, 
and that Supreme Court decisions on the place of religion in the 
schools had widespread Impact. (Quality and equality of 
opportunity in education have become matters of national 
■ concern. All levels of government, and a variety of branches 
and agencies at each level, are now deeply Involved in a 
complex and uneasy partnership whose collective alms are 
transforming educational priorities and methods. Education, 
like so many other governmental services, has now become 
involved in a "marble cake," not a "layqr cake," of 
federalism.! 

Besides managing the vastly expanded Federal role as change agent 
In the substance of public education, the United State Office of 
education has had a responsibility since its founding for charting 
"the condition and progress" of America's schools. 

How effectively the Federal government has pursued these dual 
roles as both catalyst and chronicler of change is open to serious 
question. General accord on the part of those concerned about American 
education could ,horvever, be found on the need for Improvement in the 
quality of Federal education decision making and implementation. 

This report attempts to pinpoint one of the major hindrances to 
securing a wiser and more effective Federal role — the absence of 



Stephen K. Bailey and Edith K. Mosher, ESEA; The Office of 
Education Administers a Law . Syracuse: Svracuse University Press, 

1968, p.2. 



appropriate information to undergird educational policy making. 

The problem; An information gap 

Participants in educational policy making — be they public 
officials, researchers, educators, br Interested citizens — are haudi- ^ 
capped by deficiencies in the available information on the state of 
American education. The data base that should be drawn upon in eval- 
uating current policies and in designing new programs is woefully 
Inadequate. This Inadequacy may be traced to two causes: first, and 

most important, data are not organized in ways that would facilitate 
policy formulation, and second, data are scattered among a variety of 
agencies. The problem is particularly acute in connection with the 
development and implementation of national priorities in education. 

A few questions that policy makers might reasonably raise will illustrate 
some of the shortcomings of current educational statistical reports. 

If one seeks to know the total fiscal impact of all relevant 
federal programs on education In particular school districts, data 
are unavailable in any one place or In any single report. Similarly, 
if one would like to know how much federal support is being provided 
for urban school districts, or impoverished rural districts, or 
districts with high proportions of non-white students, one cannot find 
Infomatlon In accessible form. Suppose, one were interested in 
designing an educational aid formula vjhich would take into account 
the total services — both educational and for general governmental 



functions — being supported out of a given community tax base. 

Again, such data must currently be pieced together from a variety of 
sources. Statistics on differential resource allocations within 
school districts have not heretofore been collected, yet without them 
the fiscal incidence of educational aid programs cannot be determined. ' 
Other important areas of information shortage include (1) the educa- 
.tional impact (.the achievement outputs) of the schools, and (2) the 
status of education and finance in the non-public schools of the 
nation. 

The failure to organize data for policymaking 

Policymakers must of necessity think in terms of classes of 
objects and objectives. At present ve do not provide them with the 
- appropriate categories of data. Formulating effective public policy 
for the support of elementary and secondary education requires a 
knowledge of Cl) the demand for various kinds of educational services , 
both at present and in the foreseeable future; (2) estimates of the costs 
of those varied demands; (3) a conception of equity In the distribution 
both of educational services and of the costs of those services; (4) a 
continuous monitoring and evaluation of the financial , and to the extent 
feasible, the educational. Impact of federal programs in particular 
and of American education more generally. Unfortunately, data about 
education is frequently presented In undigested, unaggregated form by 
the U. S. Office of Education, leaving those who are not themselves 
experienced manipulators of statistics at a loss to understand the 
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significance of all the painstakingly collected and refined information. 

In short, there is currently little attempt to present and 
Interpret information in policy-oriented categories like those above. 
Much of the collection of statistical material on education is 
dominated by a laudable desire for accuracy and comprehensiveness. 
Equally needed conceptual values, notably the relation of data to 
Issues of public policy, however, are not served. Overall, the fit 
between the needs of those who try to think and plan systematically 
for the future of American education and the statistical tools at 
their disposal is faulty. The hit or miss quality of many of our 
federal programs and the hunch-packed nature of much of our thinking 
on educational problems is traceable in large part to the inability 
of policymakers to draw upon relevant information as they pursue 
their deliberations. 

The scatter of data 

Besides the absence of a policy orientation in data aggre- 
gation, a second reason for the inadequacy of currently available 
information has to do with its dispersed qurJ.ity. Among the Federal 
agencies that currently collect, aggregate, and maintain information 
of significance to educational policy formulation are the United 
States Office of Education, the Office of Economic Opportunity, the 
Departments of Labor and Commerce, the Advisory Commission on Inter- 
governmental Relations, the Census Bureau, and the Office of Management 
and Budget, State educational agencies and regional associations 
are additional sources of information, as are private organizations 



like the National Education Association and the National Catholic 
Education Association. , The fact that multiple reporting and analytic 
centers exist Is not itself a problem. Indeed, it is not only an 
inevitable situation, it is a positively beneficial one. The real 
problem is that no single agency has effectively undertaken the tack 
j; providing an overview of the entire educational landscape, 

j regard to Federal programs in particular, the USOE has 

largely limited the sweep of its vision to those programs and those 
data sources administered by the Office. Thus data on early child-, 

j ■ ' 

I hood education expenditures is scarce at NCES. Shortages of data on 

I aspects of state and local finance relevant to the need and capacity 

for educational support has come about because data collected for the 
Census of Governments and analyzed by the Advisory Commission on 
Intergovernmental Relations has seldom been drawn upon by the Office 
of Education. In short, the responsibility the Office of Education 
, carried since its founding In 1867 — "to collect such statistics 

and facte as -should show the condition and progress of education" has 

bean subjected to a restrictive and self-defeating Interpretation on 

the bails of Jurisdictional lines that are unrelated to the substance 
of its mandate. 

f> ■ . 

Conclusions 

develop recommendations to improve the Information 
available to those Interested in questions of educational finance policy, 
we have examined and catalogued both the availability and the usefulness 
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of information on the important questions on the nation's educational 

agenda through interviews, questionnaires, and staff analysis. We 

have met with local, state, and national officials of both executive 

and legislative branches, and have studied reports of previous panels 

which have looked into the.- information gap in education. In addition, 

* ^ 

we conducted a two-day conference of public officials, academic 
researchers and staff of the President's Commission devoted to the 
problems of developing a comprehensive education information system 
(see Appendix E). Finally, we conducted a survey of the representa- 
tives to the Committee on Educational Data Systems (the analysis of that 
survey can be found in Appendix A) . 

On the basis of those research activities, our major conclusion 
la that the present system of educational information falls to serve 
the requirements of those who need timely, reliable and relevant in- 
formation about the nation's educational problems. From the policy- 
makers viewpoint, this failure has four critical dimensions: 

1. Information is not organized and presented within 

a policy-relevant framework. There is little indica- 
tion that Federal education data collection begins 
with the most basic of questions: data for and about 

what? 

2- Information that is collected and disseminated is 
rarely analyzed. As a result, USOE information 
typically is presented according to the alphabetical 
order of the states or the enrollment size of school 



districts, two cheracterlstlcs that usually have 
little relevance to the major Issues facing the 
nation. 

3. The fomat and presentatloxi cf the Informatian as 
well as long delays In publication discourage use 
by policy-makers. 

4. Numerous gaps exist In the availability of data 
required to answer questloni) relative to the 
education agenda of the 197l)'s. Such gaps occur 
for three reasons. 

a. Suitable comparisons from district to district 
or state to state are often not available in 
any form. Examples Include pupil achievement 
data, cost benefit data, and "needs" data In 
some basic Instructional areas. 

b. Data available for aosMt aggregations of 
jurisdictions — e>g>« municipalities and 
atatea — are not available for other 
aggregations or Jurisdictional levels. This 
Is one of the principle reasons why It Is so 
difficult to relete fiscal data about education 
Co data about other state and nmnlclpal services. 

c. To be useful to policymakers an Item of 
Informotlon must be presented In relationship 
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to another Item to create an Index which 

permits analysis and conclusions, e.g. number . 

of Title I eligible pupils per total district 

enrollment. As often as not, publications 

present raw data which are of little use to '• 

policymakers . 

Several additional conclusions about our national education 
Information system should also be noted: 

5 . State information systems have expanded and improved . 
dramatically in the past decade, largely as a result of the availability 
of federal funds (NDEA Title X and ESEA Title V) . Great variations 
continue to exist among states in both ability and willingness to 
pro’/lde the Federal government with data. 

6. A number of states are rebelling against information 
requests from Washington citing duplications, lack of established need 
for information and the high cost of collecting information not 
routinely collected. 

7. The National Center for Educational Statistics (NCES) 
has made major efforts to improve data collection procedures in recent 
years (since its inception in 1965). However, the Center is severely 
limited in that almost 90 percent of elementary and secondary education 
data are collected by program management bureaus of USOE, Off^pe of 
Civil Rights (HEW), Bureau of the Census, and the Department of 
Agriculture. Though interagency cooperation is improving, greater 
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coordination Is In order. 



8, NCES has by far the smallest budget of all major 
statistical agencies in the Federal government. Given the pressing 
need for relevant and timely infonnation and the multiplicity of 
problems associated with complete dependence upon state and local 
education agencies, the current budget of $5.7 million is grossly 
Inadequate . 

Recommendations 

The final chapter of this report contains a series of detailed 
recommendations. We believe, however, that the following three 
suggestions are the most basic and seminal ^ and we believe that It may 
be useful to present them at this point. 

1 • Information on education which eatplalns trends I n 

education, (2) Its costs, (3) conception! of equity 
In the allocation of educational services and costs, and (4) the Impact. 
both fiscal and, to the extent ppeslbla, educational of Federal prog r*** 
should be produced by an analytical staff located In the National 
Center for F^ucatlonal Statistics of the United States Office of 
Mucatlon. The function of the staff would parallel the activities of 
such agencies as the Bureau of Labor Statistics and the Office of 
Business Economics. While the Center has made important progress In 
upgrading Its statistical cotapetence In the last few years, more 
adequate analysis will require the addition of personnel trained In 
demography, economics, education, public finance, sociology and other 



areas of social science expertise. An editorial staff attached to 
NCES should Insure readability and clarity of format in NCES publications 
2. To guide improvement in NCES information gathering, 
analysis and dissemination , an advisory committee should be created. 
Composed of recognized scholars and other policy-oriented users of 
educational data, the committee should be charged with producing an 
annual report. to the Congress, the Secretary of Health, Education and 
Welfare and to the Commissioner of Education on (1) the important 
trends in the condition and progress of American education and 
(2) the state of the Office's information collection, analysis, and 
dissemination. Such a committee, with a staff of its own, would parallel 
in a general way the functions provided by such committees as the 
Advisory Commission on the Education of Disadvantaged Children. 
Specifically, it would provide the Immensely useful function in regard 
to data services of asking the essential question: "Information for 

what?" Ambitious organizational changes like those envisioned in the 
current proposal of USOE, the Common Core of Data for the Seventies, 
will serve a useful function only as a body of analytically and policy- 
oriented people influence the selection of items to be collected and 
the manner in which they are organized and presented. 

3. Ultimately, however, independent, jn-depth analysis o f 
the state of American education and educational finance will come onl y 
from an independent and distinguished body roughly comparable t-r> rhp 
National Bureau of Economic Research or the Brookings Institution. 
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Funded, perhaps, by the National Institute of Education, ma.ior 
foundations, and the Education Commlsalon of the States, such a body could 
develop the prestige and competence to attract distinguished sen-or 
scholars and the moat able Junior colleagues. Braving upon the data of 
NCES, private Interest groups, and university based research; cutting 
across Jurisdictional levels both horizontally among the agencies of 
the national government and vertically among state education agencies 
and local education agencies, such an agency is the primary hope: we 
have for the development of the all important capacity to provide 
critical analyses and evaluations of the information collected about 
the condition and progress of American education. 

Organization of the Report 

Thli report la In six chapters. In Chapter II the data collection, 
analysis and dissamlnatlon programs of the United States Office of 
Education (USOE) are placed In historical perspective. Eugene McLoone, 
professor of economics of education at the University of Maryland 
«nd.,princ5t&*<^®^ project, traces the effort of USOE 

since 1867 to fulfill its mandate to report on the condition and 
progress of American education. In Chapter III we examine the major 
producers of Information about education, the USOE and the fifty state 
education agencies. Chapter IV is devoted to an analyala of the needs 
and concerns of consumers of educational data: Federal and state 

legislative and executive branch policy-makers, researchers and 
foundations, educational Interest groups and education Industries. 



The policy Issue framework that we propose be employed to 
determine which data to x:ollect, analyze and disseminate are developed 
in Chapter V. Finally, Chapter VI is devoted to a summary of major 
conclusions and our recommendations which are designed to provide 
the Federal government with the capability to meet the Information 
needs of policy-makers. 

A supplementary document to this Report has been prepared by 
the Policy Institute. That supplement is an inventory of data, 
by source and collection level currently available. Data items 
are, organized according to policy issue framework developed in 
Chapter V. 
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CHAPTER II 

THE HISTORICAL PERSPECTIVE OF DATA GATHERING AND 
REPORTING IN THE UNITED STATES OFFICE OF EDUCATION 

\ 

V 



"Section 1. - There shall be established, at the city of 
Washington, a Department of Education, for the purpose of 
collecting such statistics and facts as shall show the condi- 
tion and progress of education in the several states and 
territories, and of diffusing such information respecting the 
organization and management of schools and school systems, 
and methods of teaching, as shall aid the people of the United 
States in the establishment and maintenance of efficient school 
systems , and otherv^ise promote the cause of education through- 
out the country." 




Thus the organic act of establishing the United States Office of 
Education (USOE) made the collection, analysis and dissemination of 
statistics and facts on the condition and progress of education the 
first purpose of the. Office. In this chapter we examine the manner in 
which that purpose has been served over the past 104 years. Particular 
attention is given to the relationships between emerging educational 
policy issues throxighout the period and USOE studies and publications. 

The principal question is , hox>7 adequately has the Office over-time 
fulfilled the mandate to report on the condition and progress of education? 



This chapter was prepared for the Policy Institute, SURC by Eugene 
Mcloone, Professor of Economics and Education at che University of Maryland. 
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Of major importance to an understanding of the data management problems that 

I . 

continue to face USOE is the discussion of the s imultaneoui? occurence in 
the mid-1960's of three events which diverted resources from statistical 
programs: reorganization of the Office, implementation of the Elementary 

and Secondairy Education Act (ESEA) , and production of the Coleman Report 
("Equality of Educational Opportunity") . 

D ata collection; the continuing struggle 

Throughout the history of the Office, problems of data collection as 
well as widely divergent attitudes within the education profession about 
the needs to be served by such Information have hindered the achievement 
of the primary USOE mandate.^ As early as 1868, when the U.S. Office of 
Education was slightly more than a year-and-one-half old, the Secretary 
of the Interior said that there was "no necessity of knowing anything 
whatever about education," In contrast, Henry Barnard^ the first 
Commissioner of Education in the United States, had worked on his own 
initiative since the early 1830's to obtain data on the status of education 
ami the educational attainment of the American people. He succeeded in 
persuading the U.S, Bureau of Census to Include questions on literacy in 
the 1840 Census of Population. Representative James A. Garfield of Ohio, 

1 

One need only read the 1963 report of the Advisory Panel on 
Education Statistics to find that the problems continue into the present. 
The 1963 Report calls for a permanent advisory group rather than temporary 
groups, citing as evidence the slight success of the 1957 and 1960 
temporary panels. Report of the Advisory Panel on Educational Statistics 
OE-20061, December, 1963. 

2 

For much of -its history, the Office of Education was part of the 
Department of Interior. 
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who was to become the twentieth President of the United States, impressed 
by the data from the 1880 Census of Population, joined the proponents of 
a greater effort to collect information about education in the several 
states . Garfield wanted information to show up the laggards and thus act 
ly' as a stimulus toward improving conditions in the "backward" states. 

Barnard had sought information for the same purpose as well as for 
collecting and presenting facts about the number and types of schools, 
teachers, teacher training, teaching conditions and teacher requirements. 
The contrasting views of Barnard and Garfield on the one hand and the 
Secretary of Interior on the other, continue to exist today, more than a 
ntury later. 

Until the early 1900 's information about the condition and progress 
of American education was extremely limited. The Annual Report of the 
Coimniss loner was the single source of data. Such data were obtained from 
questionnaires and surveys mailed to State Departments of Education and 
selected local school districts. 

About 1905, the United States Office of Education embarked upon 
the development of an Information system about education in each of the 
states. Central to this operation were specialists in education who had 
developed a close working relationship with personnel in State Education 
Departments and local districts. This specialist approach to the Office's 
relationships with the states in general and the collection and dissemina- 
tion of data about American education in particular characterized OE 
operations until the mid-1960's. The Office published results of special 
surveys, state surveys and analytical reports. In addition. Information 
was diffused through the personal consultation function of the specialists. 



who also collected data during their visits to states and local school 

I 

i 

districts . 

Thus, In 1928, L.A. Kallback, Secretarj- of the Interior, could 
state to the meeting of state representatives on Ilnlfom Statistics 
that the state representatives in the audience "know the difficulties 
in obtaining promptly accurate and comparable statistics." He and Harry 
Phillips - then the chief of data collection and a 30 year veteran of 
educational statistics - could list the problems of the U.S. Office of 
Education as (1) "delays in reporting" for which "serious difficulties 
exist in the initiating sources" (The Office then, as now, published data 
as fast as the slowest reporting unit permits); (2) "no ascertainment of 
the needs of the users"; (3) "no anticipation of new needs" and (4) "lack 
of planning and scheduling of statistical reporting and publication."^ 

The generalised need for data that is timely, accurate and relevant has 

continued until the present. 

This is not to say that important publications have not been produced. 
On the contrary, by the 1960's the U.S. Office of Education had nine 
series on a periodic basis devoted to public elementary and secondary 
education, as well as one on hlgiher education. The Biennial Survey of 
Education which was begun in 1917 covered the number and type of schools 
and school districts, staff, enroll«nts, and finances. Including both 
revenues and expenditures. Some of the information was available for 
states; more detailed information was available for large and medium s:ize 

rTTTrP from the typescript of the morning session of December 
11, 1928“^ uniform Statistics. Tte Set^ro°f the 

ra?Lri'’Eru“tlor^sriatLn Entitled i^ Hecords and Report , 1928. 



-.18 - 



er|c 



25 






cities, rural schools and county school districts. Some data were 
collected and published' annually; ethers bi-annually, or once every 
five or ten years. Special publications dealt with the following topics: 

- school district reorganization 
characteristics of school board members 

- school insurance 

- children's body measurements 

- specialized facilities and equipment 

- functions of state departments of education 

- financing school facilities 

- state-aid programs 

- organization of elementary and junior high schools 

- secondary school innovations 

- legal requirements for certification 

- teacher turnover 

- high school dropouts 

In addition to the vital statistics, special reports and surveys, 
reports of the grant programs of the U.S. Office of Education such as 
Vocational Education (VEA) , School Assistance to Federally Affected Areas 
(SAFA) , and the National Defense Education Act (NDEA) , produced informa- 
tion related to the administration and evaluation of each program. In 
addition, the distribution of reports and publications to the education 
community increased threefold during this period. The hlghpolnt of these 
activities was reached in the early 1960 'a just after the passage of NDEA 
in 195C and before ESEA in 1965. 



Data gaps - a persistent problem 

Although the sixty year period from 1905 to 1965 was characterized 
by the development of the specialist system in the U.S. Office of Education, 
which provided a standard series . of statistical publications and periodic 
reports on current issues, gaps in information useable for policy making were 
almost constant. Special Congressional appropriations for studies, and 



research efforts by private foundations, by individuals or by professional 
associations sought to- eliminate the gaps. Often funds available from one 
source did not see a study to compl&tion and another group had to finance 

the effort. On numerous occasions the U.S, Office of Education sought 
to continue the task begun by others, but more often than not was unable to 
see it through to completion, ^ 

The shifting and emergence of issues during the period from 1870 to 
1940 were reflected in publications of tht Office.^ The literacy level of 



the population and the number of college graduates, listed by state and the 
Nation, were obtained from the 1870 Census of Population and published. 

The decade of the 1870 's also saw attention placed on the constitutional 
provision made by the states for education, as new states were admitted 
and older states revised consltutions . In 1885, data on personnel, 
finances, pupils and buildings of large city school systems were collected 
and published. These city school systems were held up as models to be 
emulated by other school systems in their respective states. In 1890, 
Chapter 28 of Volume 2 of the Annua.l Report of the Coirnnisaioner of 
Education presented educational statistics collected on cities and states, 
including data from the 1890 Census of Population. The effort was not 
repeated until George Strayer prepared the 1930 Annual Report. Histories 
of education, sponsored by individual states, appeared gradually over the 
period from 1885 on, at widely varying times. Content also varied; some- 
times the history gave statistical data, sometimes only higher education 
was covered, at other times only secondary education was the subject. 

summary of topics covered in Office of Education publications 
1870 through 1939 appears at the end of this chapter. 
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In 1905, a compendium of state education legislation of the. previous 
biennial sessions of state legislatures was first published by the Office, 
and continued periodically. The Cubberly Source Book and the "Model 
Constitution for the State of Osceola" served as an updating of educational 
finance data for the 1920's that was not done again until the National 
Educational Finance project began in 1969. Internal documents, similar 
to those on the borrowing capacity of state and local governments prepared 
for the Secretary of Health and Education in the late 1950 s, for National 
legislative purpose, are the closest parallel to present government documents. 

The Research Division of the National Education Association continues this 
series today under the title Highlights of State Legislatio n, with additional 
legal material covered in Pupil *s Day In Court and Teacher ^8 Day in Court. 

Bulletin #4 of 1909 contained data on educational expenditures and 
educational salaries , The effort was not repeated until the Biennial 
Surveyo began in 1917. In 1913, attention was directed by bulletins to 
efficiency measures in the schools and the economical use of time. A 
special survey in 1914 resulted in bulletins [on compulsory attendance 
laws and their enforcement, schools and employment, the organixatica 
of schools, and the organization of state departments of education. 

In 1915, the subjects of state-instead-of-local financings, utilization of 
school buildings, and salary payments were examJ.ned. In 1916, state 
pension payments to school employees were subjects of Office publications. 

Also in 1916, a school survey of Wyoming was conducted and the 
following year, a survey of Colorado was conducted and published. These 
school surveys were the beginning of the specialist effort to assist the 
states through a comprehenBive review of the educational system and its 

28 
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finances as an aid to the mapping of future policy. The process of conducting 
a school survey also made the specialists knowledgeable about the condi- 
tions in a given state and provided an informal channel for them to share 
knowledge gained, as well as providing an appreciation of the overall 
problems to be solved. Such working relationships with educators in the 
states continued in varying degrees up through the 1960's. 

In 1917, Bulle :ln 22 on the Money Value of Education sought to 
mobilize additional resources for schools by calling attention to the 
Investment character of educational spending. In 1917, the Office of 
Education also presented data on practice teaching and superintendents'' 

A 

salaries. 

Such special subjects as kindergartens, school legislation, data 
on crippled children, a special survey of cities, and school district 
organization attracted attention In 1918. In. 1920, a nationwide data 
collection of principals' salaries was published and in 1921, certifi- 
cation laws and a bulletin on school funding. In 1922, a first 
was scored when Bulletin presented data on public school finance. 

In 1923, education efforts by such non-school agencH&s as the Young Men's 
Christiari Association and the Knights of Columbus were made part of the 
Biennial Survey. Also data were gathered and published on school trans- 
portation and distribution patterns of free textbooks. In 1924, bulletins 
directed attention to the use of buildings, and the Idea of double 
shifts (or platoon schools) was presented as one possible solution to 
problems of crowding In large city schools. District consolidation 
made roads possible and bus transportation received attention. In the 
same year, a bulletin was published on prison schools. 



In 1925, the personnel of State Departments of Education, the 
Parent-Teachers Associations and Medical Education received bulletin 
attention. High school graduation, in terms of requirements and members, 
was examined in 1928 j and in 1929 a bulletin appeared on state aid and 
taxes. 

Policy issues since 1920 

The state studies of the Educational Finance Inquiry of the 1920 's, 
the Cubberly Source Book, and the early publications of the Research 
Division of the National Education Association demonstrated the serious 
gaps in educational data in the form required for policy-making purposes 
following World War I. 

Although the U.S. Office of Education had pioneered state studies 
with its early histories of education in the states and had conducted 
studies in Wyoming and Colorado In the middle 1910-^S", such Important 
questions as appropriate methods of financing for local schools and the 
organization of school districts and state departments of education had 
been neglected. With the lessened importance of state endowment funds 
after 1890 and with the growth of high schools ; from 1890 on, methods of 

i 

financing and organizing schools became of continuing interest in the 
1920 's. The Educational Finance Inquiry struck at the earlier economics 
presented by Office bulletins in 1913 and later in 1925 in the recommen- 
dations for platoon schools. 

The Cubberly Source Book went beyond the examination of a few states 
in the Education Finance Inquiry and did the Important basic task of 
codifying state school laws on attendance; organisation of schools 



districts and State Departments of Education; local taxes; state aid 
plans; certification; buildings; and data on assessed valuation, personnel, 
pupils and retention rates. Cubberly set the basis by comparing the 
actual situation in a given state with his "ideal” constitution, the 
statutes and organization for the mythical State of Osceola. In much 
the same manner that Bulletin 6 of 1922 complemented the studies of the 
Educational Finance Inquiry. Bulletin 29 of 1929 updated some of the 
Cubberly data of the early 1920'3, and special studies of individual 

states continued the effort throughout the 1930 s. 

Also in the 1930's, the Research Division of the National Education 

Association gathered data on the salaries of teaching personnel, the 
financial ability and effort of states, state aid plans and taxes used 
for schools. The major reasons for tUaae independent efforts by NEA were 
that Office data had large time lags, completeness of coverage varied among 
the states studied, and there was no effort made to Integrate single 
series into a composite picture for policy purposes. Equally important, 
of course, was the need of NEA to have such complete data available for 

US6 by state and local affiliates # 

In the early 1930's, attention was again focused on the Incomplete 

job the U.S. Office of Education had done in analyzing existing data and 
in collecting data relevant to policy questions by the National Survey of 
School Finance (NSSF) , the National Survey of Secondary Education and the 
Survey of Educating Minorities. The Issues brought forward by NSSF were 
the variations in ability, effort, and expenditures by school districts 
both within a given state and among states. In a new approach, the NSSF 
analyzed sources of educational funds from taxes and by state or local 



level; the relative importance of educational revenue and expenditures In 
the state-local public sector; the organization of school districts; the 
availability of educational opportunity; and the interrelated behavior of 
these variables. Dlstrlct-by-dlstrlct data, rather than state totals were 
sought. Legal descriptions of state aid plans, procedures for reorganiza- 
tion of school districts, and other data similar to that given in the 
Cubberly Source Book were collected. 

NSSF recast data from the Governments Division of U,S. Bureau of Census 
to answer questions regarding the relative importance of education in state- 
local public sector and divergence between sources of school finance and 
the general state-local sector. The Ijsue of Federal aid to education was 
examined and the devising of distribution formulas for state or Federal 
grants undertaken. Esqpenditures for schools were separated to show those 
areas controllable or nancontrollable by local boards. The effects of 
organizing large districts to insure better educational opportunity, 
greater program breadth, and more equitable tax burdens than existed 
were portrayed. The Study of Secondary Education continued to focus on 
these concerns by looking at the achievement and development of individual 
pupil potential through better course offerings and better-prepared 
teachers. Parts of NSSF data collection and analysis have been continued 
by the Office.^ Publication of the reports of the National Survey of 
School Fincince was financed by the American Council on Education, 
illustrating once again the problem of diffusion faced by the U.S. Office 

^For example : Profiles of School Support , Public School Finance 

Programs , 1957-58 and State Surveys of the 1930 's by USOE. 



of Education from time to time. 

In the late 1940 's' the gap between the type of data available and 
the major policy Issue needs of the period was illustrated by a report of 
the Council of State Governments. In order to answer questions about the 
financing of public elementary and secondary schools, parts of the Council s 
report used information from the NSSF and the Cubberly Source Book. At 
about the same time, Senator Robert A. Taft shepherded through Congress 
approval for a School Housing Survey designed to determine the actual 
condition of American school facilities. The survey led directly to the 
enactment of P.L. 815, authorizing federal financial assistance for 
aehool construction In federally affected areas. 

The problems of data gathering by the U.S. Office of Education In 
the Immediate post-World War II period are summarized In a 1950 report of 
the Public Administration Service. Almost identical problems continue to 

exist today. 

Therefore, although the U.S. Office of Education had developed both 
recurring and special studies, conducted by specialists with the knowledge 
and experience to analyze most educational problems, important gaps In 
Information appeared time and again In the 60 years from 1905 to 1965. 

The Office was not able to develop and maintain a consistent statistical 
program to provide Information organized for policy formulation. 

Since 1965; cultural shock and management crisis 

Given the disparities and uneven character of data collection 
activities In the Office of Education, It was not surprising that when 
faced with the massive shift In demands for data of the mid-1960's, the 



Office was not able to maintain the capabilities developed since 1905. 

New demands occurred because emerging educational issues facing policy- 
makers became apparent at the same time that the Office was required to 
manage programs designed to resolve those issues. Hence the need for new 
types of information. The vehicle for meeting the educational problems of 
poverty and the need for quality education and equal access to educational 
services was the Elementary and Secondary Education Act (ESEA) of 1965. 
Existing procedures for collecting and analyzing educational data were 
totally disrupted due to the simultaneous occurence of (1) implementation 
of ESEA, (2) the reorganization of the Office to meet new demands under the 
then Commissioner Francis Keppel, and (3) preparation of the Coleman 
Report (Equality of Educational Opportunity). Unfortunately, although 
shortcomings existed long before 1965, statistical collection and analysis 
has been even less satisfactory since that time. 

A contributing cause to the deterioration of data collection by the 
U.S. Office of Education from its usual sources, state departments of 
education and other organizations, has been the recent turnover in personnel 
at both the U.S. Office of Education and in state departments of education. 
Major expansion of statistical optirations in the Office took place in 1917 
and the 1930’s. During a large part of the period from 1917 until the 
late 19.50's, the state respondents and Office tabulators remained the same. 
Each understocd the other and data differences were resolved on a personal 
basis to the satisfaction of both. After 1958, through the impetus of 
Title X of the National Defense Education Act, maay states automated and 
computerized data collection. About this time, a new but related problem 



emerged centering around the transition between the old method of 
reliance on personnel for all data collection and other procedures and 
the new demands Imposed by the computers. The aging of existing state 
personnel speeded the process of automation, since those retiring were 
replaced by specialists In computer work. State computer personnel are 
more likely to change jobs or obtain Increased responsibilities ■ than their 
older counterparts. As a result, state educational data collectors 
changed often in the decade of the 1960*s. Also, the late 1950 's and 
early 1960 's saw many federal level statistical personnel retire from 
the U.S. Office of Education. While personnel changes would ordinarily 
have little effect on a rqutlnlzed operation, they created many bottle- 
necks in’" the new computer related data collection procedures. 

While the Keppel reorganization, the implementation of ESEA and the 
Coleman Report are highlights of the 104 year histor' of USOE, the fact 
that all three activities occurred at the same point in time had a 
critical impact on the ability of the Office to perform, basic tasks 
designed to report the condition and progress of American education. 

In sum, in the mid-1960'8 a void was created in information manage- 
ment activities through the retirement of a number of experienced 
statistical specialists and the transfer of others to ESEA program moni- 
toring posts. Thus fewer experienced personnel were available to handle 
the recurring statistical tasks that cons tltuteii the original mandate. 

Also, the all-out effort made by Office personnel to tabulate, analyze and 
publish the Coleman Report .so disrupted routine statistical studies that 
few are yet back on schedule . 



Summary of Topics Covered in 
Office of Education Publications iSjO's Through 1930 's 



Decade 
1870 's 

1880 's 

1890's 

1900's 

1910's 



1920's 



Topic ^ 

Literacy 

iHigher education - number of college students by state/ 
nationally 

States' constitutional provisions for education 

*x***jf It «»«»***« 

Large city school systems: personnel:, finances, pupils, 

buildings 

Consolidation of information on cities and states 

States ' educational legislation 
Educational expenditures and salaries 

Efficiency measures and economy of time; utilization of 
school buildings 

Salaries; pensions paid school employees 

Organization of schools and of school districts 

Organization of state departments of education 

School legislation; ccmpulsory attendance lavs and enforcement 

State financing of education 

Investment chruractei’ of educational spending 

Schools and employment 

Data on practice teaching 

Handicapped children 

Provisions for kindergartens 

Ccmpreh.ensive school surveys by states and special surveys 
of cities 

Public school finance: state aid; taxes - state and local 

ability and effort; school organization; problems of 
devising nev methods of financing and organization 
Codified state school laws on attendance 
Retention ability of schools 
Organization of schools and school districts 
State departments of education: organization and personnel 

Use of buildings: double sessions; consolidation made 

possible by roads and bus transport 
School transportation 
Free textbooks 

Education by non-school agencies 



Table IV - 1 continued 



Decade 



1920 's 



1930's 



Topic 



con't Prison schools 

Medical education 

Parent Teachers Associations 

Pupils 

High school graduation requirements; members 

Certification lavs 

Salaries 

Public school finance: district-by-district and inter- 

state variations in ability, effort, expenditures; 
sources of funding - tsjces and by governmental agencies; 
relative importance of educational expenditures in public 
sector; divergence between sources of educational finance 
and other governmental services, financing; state aid 
Federal aid to education 

Organization of school districts; educational and fiscal 
effects of reorganizing into larger districts 
Quality and quantity of teachers 
Retention power of the schools 
Availability of educational opportunity 

Interrelated behavior of many of above mentioned variables 
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i THE PRODUCERS OF EDUCATION INFORMATION 

i 

I- *' 

'' k 

■ We turn now to an examination of the producers of data about 

I; American education. In the first section of this chapter we look at the 

j agency within the USOE primarily responsible for collecting, analyzing 

i and disseminating information: The National Center for Educational 

' 

; Statistics (NCES) . The growth of the Center over the past few years and 

i \ 

its ability to perform designated functions will be compared to other 
federal statistical agencies with similar mandates. Particular attention 
is given to data collection activities of the USOE that are not the 
responsibility of NCES. In addition, USOE plans to develop a compre- 
hensive education information system integrating state and federal 
3y3 tl6IDS BKHUlltlBCl* 

Second, we take an extensive look at the more critical links in the 
educational information chain, the states and local school districts. 
Emphasis is given to ways in which the Federal government has attempted 
to improve the information capabilities of state education agencies (SEA) 
during the last fifteen years. The adequacy of state information systems 
and, in particular, the relevance of state publications for state level 
policy making are also discussed. 
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The Matl onal Center for Educational S tatistic^ 

NCES was created in 1965 to serve as the statistical arm of the 
Federal government's efforts ih education. A part of the Keppel re- 
organization discussed in the previous chapter, the establishment of the 
center was intended to elevate and coordinate basic information activities 
I of the USOE. In that role NCES currently gathers, stores, analyzes and 
I disseminates general purpose - as opposed to specific program management - 
I educational information- A small amount of data collected by other 

[ statistical agencies of the Federal government (i . e. , Census) is also . 

I included in the 55 series of publications. 

1 The budget for NCES activities grew more than six fold during the 

i 1960's from $.9 million to more than $5.7 million.^ With the exception of 

I statistical operations of the newly created agencies of the 1960's (the 

I Department of Housing and Urban Development, 3.0 million; Transportation, 

5.7 million; and the Office of Economic Opportunity, 4.9 million) ,the 
budgeted rate of increase in data collection for education was greater 
than any other statistical center in the Federal government.^ Nevertheless, 



^Federal Statistic_^ Report of the President's Commission, Volume I, 
Chapter 1, Appendix B, pp. 41-42. 

^The $.9 million covers only routine operational expenditures inducing 
nersonnel salaries and benefits as well as cost of data collection and 
Dublications. Special studies such as the Coleman Report ( 1966, approjd- 
iftATn computer facilities (1967 approximately ^^ion) 

are not included. However, the longitudinal study in hig er ® ^ ^ 

currently underway is included. If it were f actu^^ 

additional statistical activities of the early and ® 

rate of Increase would appear considerably smaller than it does with 

budget data used here. 



- 32 - 



O 

ERIC 



39 






9/T .» Vf •'►/rVKr* 



at 5.7 ralllion dollars, the NCES budget for fiscal year ].97]. is far leas 

than each of four other Federal government agencies whose missions closely 

approximate those of USOE, Table III-I compares Congressional appropriations 

for 1971, personnel ceilings for both years, and the amount of change in ' 

dollars and personnel frfpm one year to the next in those agencies. 

The closest parallel to NCES in the Federal government is the 

National Center /or Health Statistics (NCHS) within the Department of 

Health, Education and Welfare. The NCHS budget for fiscal 1971^ was alncst 

twice that of NCES; in 1972 it was almost three times as large. More 

important, NCHS received a larger single increase ($5.2 million) from 1971, 

2 

to 1972. That Increase of $5.2 million was almost as large as the total’ 
budget of NCES in 1971. Equally Important are the differences in staff 
sizes. NCHS had more than three times the staff of NCES in 1971 and almost 
four times the staff planned for fiscal 1972. Other agencies included in 

the table employ up to twenty times as many staff. Even though such com*- 
parisons among statistical agencies cannot be definitive, they do reflect 

^NCES is the only one of the five agencies Included in the table 
whose budget is not subject to line item appropriations by the Congress. 
Rather, Congress approved a USOE budget that Included an additional 
7 million, but when funds for research were cut in the OE budget, NCES 
was reduced by that amount to free-up extra funds for research. Budgets 
for each of the other agencies were as indicated. 

2 

Unless otherwise stated, all dates are for fiscal years. 






Table III-l 

MANPOWER AND DOLLAR FlESOURCES 
OF THE GENERAL PURPOSE STATISTICAL AGENCIES 
FY 1971 and FY 1972 



Statistical 



Personnel Ceiling 



Agency FY 1971 


FY 1972 


Changes 


FY 1971 


FY 1972 


Changes 


National Center 
for Educational 
Statistics 


$ 5.7 


$ 6.1 


$ 0.4 


148 


157 


9 


National Center 
for Health 
Statistics 


10. 1 


15.3 


5.2 


459 


583 


124 


Statistical 
Reporting Service , 
Department of 
Agriculture 


18.6 


18.9 


0.3 


1339 


1355 


16 


Bureau of 

Labor 

Statistics 


26.4 


29.4 


1.8 


1416 


1562 


146 


Census 


22.6 


24.4 


1.8 


3566 


3724 


158 


Source; Department 


of Health, Education and 


Welfare 










the cowparitive value that both the' executive and lefrislative brances of 
govemitent have placed on the collection of accurate, timely and useful data. 

These disparities are particularly surprising when viewed in the 
context of the activities being sur\'eyed. In terms of gross measures 
of the subject areas covered by each of the three statistical agencies, 
education generated the largest dollar volume in 1970. But education is 
not only a major national effort fiscally, it has been the focus of intensive 
criticism and concern on official and unofficial state and local levels in 
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recent years. Indeed, for well over one hundred years Americans have 
placed much of the burden for relieving social inequities on their system 
of public education. Given the serious need for a program within the 
U.S. Office of Education that is capable of producing high quality, use- 
ful information to undergird intelligent public policy decisions, there 
appears to be generous room for budgetary growth in the area of education 

Table - III-2 

GROSS MEASURES OF SIZE OF SUBJECT MATTER AREAS 
COVERED BY GENERAL-PURPOSE STATISTICAL AGENCIES 
U.S. TOTALS FOR FY 1970 



Statistical 

Agency 

NCES 



Measure of Size Dollars In Billions 

Educational Expenditures $ 70.6 

(Public and Private) 



NCHS 

SRS 

(Agriculture) 
Source: Department 



Health Expenditures 
(Public and Private) 

Realized Gross Farm Income 



of Health, Education and Welfare. 



67.2 

55.6 



Our primary focus in this report Is on information about, education 
up to and including high school,. Table II1-3 illustrates that approximately 
60 percent of the funds and about half the personnel involved in surveys 
are devoted to the areas of elementary and secondary including vocational 



educ^tilon. 



Table -111-3 



NCES RECURRING SURVEY EFFORT - FY 1971 





Related 
Publications 
Scheduled for 
Completion 


Total 
Research & 
Training 
Dollars 


Related 

Staff 


Recurring 

Surveys 








Higher Education 


17 


$ 613 


34 


Elementary & 
Secondary 
(including SSS) 


20 


934 


25 


Adult & Vocational^ 
and Library Ed. 


6 


73 


14 


TOTALS 


43 


$1620 


73 



While NCES is nominally the focal point for educational statistics, 
the Center processes only 10 percent of all data submitted to USOE. The 
reason for this comparatively low proportion of data processing is that 
the great bulk of information supplied by States and local school districts 
to the Office is submitted to the program monitoring bureaus. Such data 
are used for internal program management and are rarely integrated with 
recurring, general purpose information. In many cases the surveys emoloyed 
are required by legislation and, typically, fulfill no further purpose 
than the minimal requirements for the legislation. 



1 

Includes hlgb.er education as well as elementary and secondary. 
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Two examples illustrate different dimensions of this problem. 

Recent amendments to Title I of the Elementary and Secondary Education 

Act (ESEA) set precise comparability requirements for the intra-district 

allocation of resources. There can be no more than a 5 percent variation 

in local, state and other federal funds between the average of all non- 

Title I schools in a district and each Title I school. USOE has a 

comparability report form that is made available to Title I administrators 

in state education agencies (SEA's). These forms, occasionally with 

minor modifications, are sent to each local education agency receiving 

Title I funds, in effect almost every school district in the United 

States.^ For school districts without school -by-school budgeting and 

accounting — the vast majority — the task is massive. The City School 

District in Syracuse, New York, for example, estimated that more than 500 

2 

man-hours were required to complete the form in the Spring of 1970. 

Completed reports were then submitted to the SEA where compliance 

and district plans to make corrections are assessed. USOE may ask the 

3 

sea’s to send reports for those districts in the Belmont sample to 
Washington, but this is far from definite at this time. 



^Two kinds of districts were excluded from completing the entire 
report. District receiving less than $50,000 were required to complete 
only one of three sections. Districts with one elementary school were 

excluded entir^ily* 



2 

In subsequent years 
three consecutive years 
less, of course. 



— the report must be completed for each of 
the time required should be considerably 



^The Belmont survey is designed to collect data for USOE 
evaluation purposes. It will be discussed in greater detail later in this 

report. 



Furthsmiore , there are no plans to incorporate the data from the 
comparability study into the NCES information program and the Center's 
Director has little knowledge of the study. At a time when NCES is placing 
major emphasis on developing good relationships with the states, and some 
sea's are in fact, refusing to honor USOE data requests, the lack of 
Integral involvement of NCES in planning and administering the study can 
be deplored. Since tnr study is required by law^ and there has been 
increasing concern expressed to NCES about school-by-school disparities 
in large cities^, coordination with the Center could have resulted in at 
least making the unavoidable burden for local districts serve multiple 
purposes. Such coordination will only occur as a result of clear direction 

from the Office of the Commissioner. 

A second example of the extensive data collection that occurs out 
side of NCES is also related to the controversial Belmont survey. Bel- 
mont was designed to gather data for program evaluation from school 
districts and schools. A subsidiary purpose was to combine information 
collected through several surveys into one survey. The principal 
Instruments are the Consolidated Program Information Report (CPIR) on 
which data about all federal programs at the school district level are 
reported, the Elementary School Survey (ESS) and the Secondary School 
Survey (SSS) . 

^This is somewhat of a misnomer since the study is not specifically 
required, only the results are. 

^As an example, the Committee on Educational Finance Statistics 
recommended that NCES collect school-by-school data on a sample basis in 
its report of March, 1970. 



Belmont was conceived and Implemented within the Bureau of Elementary 
and Secondary Education. The CPIR, EES and SSS require states and local 
districts to submit almost as many data items as all of the Center s 
elementary and secondary surveys put together, yet NCES has little 
involvement. In most SEA.'s separate "Belmont representative" is selected 
by the Chief State School Officer and his work is done independently from 
that of the representative to the existing Committee for Educational Data 

Systems (CEDS) who regularly deals with NCES. 

This separation of Belmont from NCES has been partially alleviated 
by a minor reorganization within the Office of Education. NCES and Belmont 
are now directly responsible to the Deputy Commissioner for Development. 

As a first step toward better coordination within the Office, this re- 
organization is to be applauded. In the long rxm, however, a more en- 
compassing unification of information activities may well be in order. 

The Title I Comparability Study and the Belmont Project illustrate 
the difficulty of developing a comprehensive, integrated, policy-oriented 
information program for education. State and local school districts rebel 



^At a number of places in this report we have drawn upon interviews, 
with CEDS representatives and their colleagues in State Education Agenc e«. 
The CEDS representative is the personal envoy of each Chief State School 
Officer to NCES for education data. All CEDS representatives convene once 
each year to discuss implementation of USOE data programs. In addition, a 
CEDS Planning Committee meets more frequently usually with Office Staff. 

NCES seeks the advice of CEDS in both long-range and short-term planning tor 



data collection. 

The Final Report of this project will make direct use of a 
survey to all CEDS representatives. Their attitudes and opinions w^l be 
considered in developing recommendations for long-range planning. The 
questionnaire for the CEDS survey is included Jn Appendix A. 



against the extensive burden of supplying data, a burden that Is only 
partially offset by federal funds (ESEA Title V and state and federal 
fund administrative budgets).' Though NCES has major responsibility for 
reducing these problems. It has little or no control over many of the 
problems generated by practices within other branches of USOE. 

Recent studies and recommendations concerning information activities 

During the par t eight years three Independent studies of the 
activities for which NCES Is responsible have been conducted. Each study 
observed a number of problems and suggested recommendations which warrant 
our attention. 

The first study took place In the Fall of 1963 when the then 
Commissioner of Education Francis Keppel appointed an Advisory Panel on 
Educational Statistics. The panel was composed of 15 distinguished 
educators chaired by 0. Meredith Wilson, then President of the University 
of Minnesota. The Wilson Committee made a number of reconnendatlons, som'a 
of which were Incorporated in the 1965 reorganization of the U.S. Office 
of Education that resulted In the creation of NCES. That reorganization 
overcame some of the problems we have listed as observed In the early 
1960's. However, the three most Important findings of the Wilson Committee 
are as current and as relevant today as they were then. Indeed, the 
Wilson Committee described them as "chronic", but we would trust that 
they are not so "chronic" that they cannot be resolved. They are as 
follows : 
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1. Long delays In the conpletlon of many studies and reports . 



As we noted above, this particular problem actually Increased 
during 1965-66 with the simultaneous occurence of the reorganization 
of the Office of Education and the iaplenentatlon of ESEA. NCES 
has yet to recover from the effect of those two events, and there is 
little evidence that this problem will be resolved in the near future. 

2. Serious difficulties in the reporting of basic information 
by Initiating sources. Involving some lack of adjustment in the 
request for data to the form and circumstances of local and state 
record systems . This problem points out the dependency of the Federal 
govemment upon the data supplying capabilities of states and local 
school districts. We will discuss this in greater detail in the 
following section, entitled "Looking Ahead at USOE." 

3. Less than adequate ascertainment of the needs of users of 
educational statistics and poor anticipation of new needs . This 
particular problem %rill be discussed in chapter IV . We note in 
that chapter that NCES has given very little attention to the 
specific needs of an important category of users of educational data: 
Congressional and top level, Executive Branch officials. NCES has 
attempted throu^ a recent User's Study to ascertain the needs of 
users of education data. However, it is abundantly clear from that 
study that no distinctions were made among the kinds of users or 
their respective needs . 
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A second and somewhat different study was conducted by the House 
Committee on Education and Labor In 1967 of the entire U.S. Office of 
Education. The House study pointed out several problems.^ 

1 

1* The lack of availability of coaputing. equipment used solely by 
NCES . A nuinber of studies from 1950, 1957 , 1963 and 1964 recomiaended 
that the Office have control over Its own cos^>utlng facilities. As of 
1967 that had not occurred and apparently has not today. 

2. The absence of information about the non-public sector of 
education Including private, parochial, ccBaercial and technical schools . 
This problem extended even to those schools that were receiving federal 
funds. In very large measure this problem continues to exist today. 

The final study that haa bearing on this project la that conducted 
by the Committee on Educational finance Statistics, commonly called the 
Kelly Committee after its chairman Professor James A. Kelly of Columbia 
University. The Kelly ComHittea was probably the first to focua on the 
critical lack of policy orientation In HCES and USOE data collection efforts. 
In the Committee's report to the U.S. Commissioner of Education Jamas A. 
Allen, Kelly noted. 

Intelligent de c Is i ^-making requires that decision makers 
at all levels of government ... have available to them the most 
up-to-date, relevant, and comprehensivs data, that It is possible 
to collect concerning (1) tha nature of the problems to be solved. 



^Committee on Education and Labor, House of Representatives, 89th 
Congress, "Study of the United States Office of Education: Report of 
the Special Subcoimlttee on Education," Washington, 1967, pp. 758-763. 





(2) the flow of Federal fund* to statea and^^local achool diatricta 
and (3) the inpact of that eld on children. 

ThJ Committee concluded that though important efforts were being 

made to provide Aeceaaary data, gaps in essential Information continued 

to exist. Areas in which data are required but unavailable included: 

1. Recognition of lack of comparability between USOE data and 

that collected by the Bursau of the Census. 

2. DatsL at local, state and national levels relating Federal 
aid by Title as well as by Act to the incidence of a target population 
at the school building level. 

3. School-by-school demand or need for educational services. 

4. School-by-school allocation of resources Including Federal 

aid in large cities . 

5. Lack of data about Federal aid that reaches children by means 
of non-USOE adsdnistered programs. 

To ov«rc<*. thM. d.t. lo.d.,u.el«.th. K.lly Co—ltt.. reco—end.d 
th.t .chool f ln«nc« d«t« b. organlMd Mound nnnlytlcl conMn deno«ln«- 
tor. to olgnlflcmt public policy In.uM, enponolon of the 

ElMentity ond SecoodMy G.nor.1 InfotnMtlon Survey (ELSEGIS) .od Beleont 
s«npl« Md progr«. nnd gt.eter coordlMtlon with other egencUn of the 

Federal government collecting educational data. 

Nine specific recosaendatiovis were Mde for acc^liahing these 
objectives. A nu-ber of the reco— end.tlon. were proposed for the 1971 



'■"Keoort of the Coemlttee tor Educstlonsl Finance Statistics: Re- 
conendstlLn lor Det. Collection Analysis sod PU.llc.tlon, Janes A. 
Kelly, Clialrman, Msrch, 1970, p. 2 
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fiscal year budget, but did not survive Off^e review. However, several 

"1 

have been Incorporated In the budget for fiscal 1972. 

Looking ahead at USOE: Conanon Core of Data for the 70*3 

One of the nore unfortunate by-products of a study such as ours 
Is the continuing focus on what Is not being done. Current efforts and 
plana for the future are typically not given the satse attention as are 
the gaps or shortcoaings In data proceduraa. Coapoundlng thla tendency . 

la the unavoidable tlaa lapse that surrounds the subject of our axaalnatlon 

•/* 

since the tlae between the coomenceaent of planning a particular change In 
an Information program and the collection, analysis, and eventual publi- 
cation Is measured In years, not In mdnths. On the one hand, we examine 
shortcoodngs In publications planned three or four years ago and base our 
judgaents on conversations with users of the same Information. On the 
other hand, through our conversations %rlth staff of the NCES and the U.S. 
Office of Education, we learn of plans to correct many of the problems 
cited, but the corrections will not be reflected In publications for 
another three to four years. 

The Common Core of Data for the Seventies (CCD-70) Is ar. example of 
the latter. CCD-70 Is designed to achieve comparability and overall 
economy In the nationwide effort to secure educational data needed on 
problems In educational practice and educational finance. It will be 
directed at fulfilling the need for (1) coordination of lederal/state 
planning toward compatible Information systems, (2) financial assistance 

summary of the Kelly Committee recommendations and their current 
status is in Appendix C. 
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for pT— Ing and ofaratlofi of coordlMtof data ayataaa, (3) finuicial 
•••iotanca and taclm^cal oarvlcaa to tha otataa, and (4) tachnical- 
statistical devalopaant of oysJtCBS of educational data in education. 

The premise underlying CCD-70 is baaed on a proposition common to 
massiw'e inforamtion systems in all spheres of activity: information 

available at the . top will be no biiCter than that produced at subordinate 
organiaatlonal levels. Thus, CCD-70 is putting its eggs in the basket 
of in>roviag the information mystem capabilities in the 50 states and 6 
outlying territories , Federal grants on a 1 to 3 matching basis would 
be available to states. Costs would run from an optimal $60 million in 
the first year to $100 million per year by fiscal 19/7, Greatly expanded 
technical and consultant services to states would be provided. While the 
staff of NCES would more than double within the next few years, it is a 
very clear purpose of the Of£icu cf Education in CCD— 70 to first meet the 
information needs of states. 

USOE is to be commanded for initiating plans for a comprehensive, 
integrated information system in education. Clearly, no other national 
organization or agency has this capacity in education information systems. 

In addition, it is our feeling that a coat of $100 million dollars a year 
nay be unavoidable if the nation is to have available the kinds of 
information that are requisite to intelligent educational policy formulation. 

There are, however, some cautions that we would like to suggest. 

Flrot, as indicated earlier in this report, there is great variation in 
the needs of the 50 states and 6 territories. Such variation is inherent 
in a federal system and is in no way comparable to the integrated though 
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decentralized administrative structures that characterize a typical 
large Industrial company » or, for that matter, the many agencies of the 
Federal government. One of the Important observations that ve have made 
from talking with personnel In various state education agencies Is that 
the uses of and the Interest In certain kinds of Information vary draaat*> 
Ically froB state to state. Serious question should be raised about the 
Intent to achieve comparability and Integration through the device of 
meeting the needs of Individual states. 

Second, If one assumes that such a task can be accomplished as part 
of CCD-70, he must recognize that the desired outcomes will occur only 
after many, many years of Intensive development. Those Information needs 
that are peculiar to the Federal government may not be adequately fulfilled 
for a long number of years If ve wait for Inforaatlon systems In each of 
the states to attain an adequate level of usefulness. A somewhat comparable 
situation exists In the state of California today. Funds for Improving 
the educational Information system In California have been directed at 
Improving the systems In Individual school districts. The result Is that 
California's state Information system Is currently disjointed and Inade- 
quate. Though In the long term the system may be superior and more 
sophisticated than those of other states, that pay-off appears to be 
several years away. 

Our third area of concern about CCD-70 Is addressed to a problem 
area that cannot await a long-term solution. As ve have noted earlier and 
often In v:hls report, the usefulness of NCES publications to policy makers 
Is largely a function of three Interrelated factors: (1) the. organization 



of publications and data around policy questions , (2) the level of analysis 
etrployed, and (3) the .roadability of the material. NCES has given 
increasing emphasis to the need for a policy orientation to educational 
data in recent years. Such an emphasis is mentioned in several places 
in documents ccncemlng CCD-70. But one quickly gets the impression from 
reading the rhetoric about CCD— 70 that attention is focused on strategies 
to ba esqtloyad in collecting data about education and very little, 
particularly at tha outset, on the quMtlon of "data for vhat. " No 
natter how useful the strategy, a comprehensive program fory collecting, 
analyzing and disseminating information about the condition and progress 

of American education will be doomed to failure unless it begins with a 

j 

careful selection and atatcsment of the issues and resulting questions for 
which data must ba collected. Only then and on this base can one turn to 
a critical analysis of existing data and determine vhat needs to be obtained 
to fill existing gaps. While this effort is certainly a purpose of our 
study, the absence, at the outset of OCD-70, of a hi^ priority for the 
identification of issues suggests that any expenditure of funds close to 
that being contemplated by tha USOE may indeed be futile. 

Also missing is a necessary focus on the development of a series of 
readable publications structured around policy issues. NCES is to be 
applauded for its current emphasis on enhancing the statistical integrity 
of education data as well as in securing the level of expertise available 
to the Office and, in the future, to states. However, concern with 
statistics and the needs and problems of State Education Agencies appears 
to be taking precedence over the Interests and concerns of policy makers 



In the Federal government. 

When we turn to the questlou of analysis, we know that a number of 
potentially severe problems exist. The 1963 report of the Advisory Panel 
on Education Statistics addressed itself to such concerns in a manner 
that has relevance today. ^ 

The data in the basic statistical series should be collected 
and reported so as co reduce to a ainimua questions or s'jspiciona 
concerning them. While these statistical data should be accompanied 
by full explanation and objective interpretation, it is desirable 
that the Office not be Involved in controversial Interpretations. 

For this purpose the panel distinguishes two levels of interpretation: 
(a) a first level which Illumines data by explaining how they were 
collected, by appraising the results obtained, by relating then to 
ether factual matters, and by deriving those valid conclusions or 
implications which are purely analytical or logical; and (b) the 
second level which interprets in a broader sense on Che basis of 
disputed value judg;ment or assuigitions or general views of any sort 
which ars not beyond reasonable differences of opinion. 

The Office should provide the first level of interpretation 
since raw data simply cannot be understood without some such inter- 
pretive guides . It is as bad to publish ambiguous and misleading 
reports as to publish Inaccurate ones. Moreover, the Office may be 
expected to be better informed about the operational and factual 
information that are needed for the Interpretation of its own 
statistics. The Office should not tmdertake to work out and present 
the second x^iype of interpretation . 

When data are organized within a policy format, it is exceedingly 
difficult to make a clear distinction between these two levels of analyses 
One of the subjecta of the final chapter of this report is alternative 
ways in which this particular kind of problem can be resolved. Such 
alternatives will include utilization of existing mechanisms within the 
USOE as well as proposed mechanisms outside of NCES and USOE, The point 



"Report of the Advisory Panel on Educational Statistics," U.S. 
Department of Health, Education and Welfare. Office of Education, 
December, 1963, pp. 18 and 19. 





to be made here, however, Is that the problem Is not In any way addressed 
In USOE plans for CCD**70. 

'ihe final concern that we have about USOE plans for CCO-70 focuses 
on that vast array of data used by states and the Office to monitor 
Federal aid programs. We noted earlier that NCES currently collects less 
than 10 percent of all data submitted by states and local school districts 
to the USOE. The Title I Comparability Study was cited as an example of 
a major project of the Bureau of Elementary and Secondary Education that 
placed enormous demands upon local school districts, but was conducted 
without Involvement of NCES. Perhaps mor^- critical, there are no plans 
to Integrate comparability data Into USOE Information publications — or 
simply to make the data available on computer tape. 

If CCD-70, or any design of a comprehensive education Information 
system Is expected to deal with the sources of major data problems. It must 
Include provisions for Integrating all USOE collection, analysis and 
dissemination activities. Dlstiactlons among policy Information, manage- 
ment Information, compliance Information, etc. , are relevant only in terms 
of the nature of the analytic report or publication that is produced from 
the data. The producer of the data — local school district or state 
education agency — Is primarily concerned with supplying the original 
Information. The particular data item, e.g. ^per pupil Instructional 
expenditures, should not change with the ultimate use to which the data 
will be put. In short, all data collecting, storing and integrating for 
USOE should be the responsibility of NCES. 



Infornation Systems at the State Level 



I'he success and efficiency of Federal government efforts to collect 
educational data are dependent upon the efforts of each of the 50 states 
and six territories. In turn, the willingness of the states to provide 
infornation, as well as the quality of the data supplied. Is a function of 
a state's educational Information system and the extent to which the state 
percelvea a need for certain data Items. If a state routinely collects 
Infomatlon from Its local education agencies, relatively little effort Is 
required to provide Washington with that Infomatlon. On the other hand. 

If the SEA Is required by USOE to collect new .ir.d/or different Information, 
both the efficiency of the operation and the quality of the data supplied 
will be affected. In this section we will review the condition of state 
-Infonaatlon systems with a focus on the expansion that has occuxrred over 
the past decade. Particular attention will be given to the role of the 
Federal government In encouraging that growth. 

To say that the quality of Infomatlon systems varies from state to 
state woiild Indeed be a mild understatement. In each state, there are 
data that local school districts must supply to the SEA In order to receive 
state aid or to fulfill other legal obligations determined by statute such 
as financial accomitlng of revenues and expenditures. Almost all such data 
concerning fiscal and pupil characteristics of school districts are 
necessary for calculating the allocation of state aid. We characterize 
such Information as legal data.^ 

^The nature of the Informfitlcn collected for these purposes differs 
from state to state. For example, there are at least four common ways In 
which pupils are counted for state eld purposes. They Include: enrollment as 
of some selected time during the school year, average dally membership (\DM), 
average dally attendance (ADA), and weighted average dally attendance (WADA) . 




The comprehensiveness and sophistication of a state's information 
system, however, is determined by the nature of the non-legal data, which 
may include such items as the following: teacher characteristics 

(experience, certification status, graduate level, tenure status), pupil 
characteristics (racial/ethnic status, special needs), curricular offerings, 
and achievement scores . It is in this area of nou-le.gal data where 
greatest variation occurs. The quality and content on non— legal data is a 
function of two closely related factors: first, the kind of information 

generally collected and published by SEA curriculum and program management 
bureaus, and second, the extent to which these and other kinds of non-legal 
items are related to each other and to legal data in order to provide a 
picture of the condition and progress of education within the state. The 
influence of either factor on the development of a comprehensive information 
system Is largely determined by the importance that policy-makers , and in 
most cases this means executive branch policy-makers, attach to the need for 
various kinds of non-legal information. 

Although there is marked uneveness among the states with respect to 
the comprehensiveness and sophistication of educational information systems, 
significant progress has nevertheless taken place during the past ten years. 
While some of that progress can be attributed to efforts initiated by state- 
level policy-makers both within legislatures and SEA’s, the growth and 
improvement that has occurred is largely a function of intervention by the 
Federal government. Such intervention has taken two forms. 

First, the demands for program management information that have 
characterized the U.S. Office of Education since 1?)65 have had a similar 



Impact upon State Education Departments. SEA's are primarily responsible 
for managing the distribution and use of federal funds within each state. 
Consequently, SEA staff have been hired, often with federal funds, to 
monitor federal programs as well as state categorical programs. Monitoring 
functions hs.ve required the collection of certain basic kinds of Information 
In addition to financial auditing. However, Information collected 
relative to specific programs is rarely coordinated. Integrated or 
published with other types of educational information. 

Second, the Federal government has sought through two different acts 
since 1953 to upgrade SEA's: Title X of the National Defense Education 
Act (NDEA) of 1958 and Title V of the Elementary and Secondary Education 
Act (ESEA) of 1965. 

NDEA Title X 

NDEA Title X, Section 1009 was enacted to Improve and strengthen 
(1) the adequacy and reliability of educational statistics provided by 
state and local reports and records, (2) the methods and techniques for 
collecting and processing educational data about the condition and progress 
of education in the United States . Matching grants were available to 
states for one-half the cost of improving educational statistics with 
a per state limit of $50,000. 

During the 1959 fiscal year most Title X funds allocated to states 
were spent on the purchase of data processing equipment. By the 1960 fiscal 
year the pattern had shifted with 21 percent for personal services and 20 
percent for miscellaneous expenditures. Before the influx of Title X funds 
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in the late 1950's,only 12 of the 50 states were utilizing electronic 



computers for data pro.cessing. Within 7 to 8 years data processing 
procedures were upgraded to the extent that all but two states were 

utilizing such equipment. ^ 

By 1965 the Congress had authorized $2.8 million per year for Title X. 
As Table IV-4 shows, somewhat less than that figure was actually spent in 
1966 ana 1967 by the Federal government. Two hundred sixty-six professional 
and 403 noti-professional employees had been hired by the states xn funded 
projects. The vast majority of these were new positions created as a 
re53ult of Title X. 

Table III-4 



NDEA-X Expenditures and Staff, 
1966 and 1967 



Federal Funds State Funds Professional Non-Professional 

expended for exp)ended for SEA employees employees in 

Administration Administration in program program 



1966 2,013,268 4,288,673 

1967 2,100,447 4,213,377 

Source: Annual Reports No. 1,2 and 3. 



276.2 407.5 

266.7 403.9 



In addition to the staff added to State Education Agencies, the U.S. 
Office of Education employed 10-12 professionals as Title X consultants to 
states. Kuch USOE consultant time was spent in the field working with SEA's 
in the reorganization and develdpment of data systems. Ttte representatives 
to the Committee on. Educational Data Systems (CEDS) to whom we have talked in 
the course of this study have to a man indicated that the period 1960-1965 
was characterized by the most effective relationships that have ever existed. 
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either before or since, between the Office and /individual SEA’s. This 

<* 

V 

occurred because USOE Title X .field staff were exceptionally knowledgeable 
not only about information sya terns , but also about the kinds of problems 
faced by SEA's in collecting data. CEDS representatives usually indicate ^ 
that Office of Education personnel were "familiar with the business of 
education." These observations fit well with the specialist approach 
that characterized the Office of Education before the reorganization of 
1965, and. discussed earlier in this report. The specialists involved in 
Title X had either been serving in similar capacities as representatives 
to the dtates for a long number of years or they had recently come to the 
Office from positions in an SEA. 

We must point out, however, that although the relationship in the 
early 1960 's between SEA's and the Office of Education was superior to 
what it appears to be today, this is not mearit to imply that the information 
systems in the individual states were also better at that time than they 
are today. On the contrary, the reverse is true. 

ESEA Title V 

In 1967 Title X NDEA was merged with Title V ESEA. Title V provided 
three programs to strengthen State Education Agencies : 

1. Basic grants to state education agencies to develop. Improve 
and/or expand professional leadership activities (Section 503). 

2. Special project grants to support experimental programs, and to 
develop special services designed to assist in the solution of 
problems common to several states (Section 505). 

3. Provision for an interchange of professional personnel to 
develop and share leadership skills in both federal and state 
education agencies (Section 507). 



Eighty-five percent or $14,450,000 of the fiscal year 1966 appropriation 
was allocated under Section 503. Functions for which these funds were 
used included collecting, processing, recording, analyzing, interpreting, 
and reporting state and local educational data^ However, Title V also 
forced the state Information system or data processing units to compete for 
federal funds along with all other branches of the SEA. Contrary to NDEA 
Title X, ESEA Title V did not guarantee that any of the federal funds 
would go to the Improvement of Information systems. In general, Information 
system improvement projects received 10 to 30 percent of Section 503 funds. 
Basic grant money constituted 35 percent of the appropriation for each year. 

Funds for Section 503 are allocated among the states on the basis of 
school enrollments. As of June 30, 1969, 22 percent of the funds provided 
had been used for statistics and data processing; 24 percent of the new 

'j 

positions under 503 Were for the same activities,. Tables IV- 5 and IV-6 show 
the percentage of Section 503 and total SEA expenditures devoted to 
statistics and data processing activities, 1965 through 1969. 

Table IV-5 

ESEA Title. V, Section 503 (Basic Grants) Expenditures 
for Statistics and Data Processing, 1966-68 





Expenditures 


% of Total 503 


Fiscal 1966 


$2,354,171 


20.93 


Fiscal 1967 


3,149,320 


10.05 


Fiscal 1968 


3,246 ,265 


17.78 



Table IV- 6 



Expenditures for Statistics and Data Processing By 
State Education Agencies, 1965-1967 







Expenditures 


Percent Total of 
SEA Expenditures 


1 


Fiscal 


1965 


4,944,181 


3.55 




Fiscal 


1966' 


8,112,505 


4.52 


y 


Fiscal 


1967 


6,882,201 


4.19 





Source: Focus on the Future; Education in the States”the Third Annual 

Annual Report of the Ad\rtsory Couucil and State Dept, of 
Education, March, 1968. 



When ESEA was enacted. Section 505 provided that 15 percent of 
Title V funds were to be used by the Coronissioner of Education to fund 
projects leading to the solution of problems common to several states. 

In 1967, amendments reduced this to 5 percent but at the same time mandated 
that the remaining lO percent be allocated to the states, to be passed 
through to local school districts In an "equitable manner on basis of need.”^ 
In its four-year history, Section 505 has supported 59 multi-state 
projects with grants totalling over $12 million. Table IV-7 shows the 
appropriations and expenditures for these multi-state projects since 1966. 

One of the more comprehensive of tht je projects was the Midwestern States 
Education Information Project (MSEIF) which was designed to aid in the 
establishment of a high quality information system compatible among 13 
midwestern states. The system will provide basic information for reporting. 






^Fifth Annual Report, pages 44 and 46. 
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analysis, research, and decision making at both the state and local 
school district level.- In addition, it will provide data for federal 
reports and for specialized research. The system consists of five sub- 
systems; (1) instructional programs, (2) facilities, (3) finance, 

(4) personnel, and (5) pupils. MSEIP received approximately $1.8 million 

in Section 505 over a four-year period.^ 

Table IV- 7 

ESEA Title V Appropriation 



Fiscal Year 


Amount Appropriated 


Amount Granted 


1966 


2,550,000 


2,549,996 


1967 


3,300,000 


3,300,000 


1968 


4,462,500 


4,402,124 


1969 


1.487,500 


1,487,50o2 


1970 


1,487,500 


747,812'^ 


TOTAL 


13,287,500 


12,487,432^ 


the first Annual 


.Report (1966) states 


that "a clear purpose 



of Act (Title V ESEA) is to secure more encouragement for state education 
agencies from state legislatures,^ one of the more noteworthy findings 
derived from reviewing the five annual reports of the Advisory Council 
on State Departments of Education is the lack of explicit mention of 
improved information services to state legislatures. In view of tne 

^The Federal State Partnership for Education, Fifth Annual Report, 
page 55. 

^Fifth Annual Report, pages. 44 and 46 

^First Annual Report, page 7 



part-time nature of the legislator's job and the virtual absence of 
individual, or even committee staff, the fundamental purpose noted above 
would seem to require greater focus on analysis and the provision of 
publications that are designed for non-specialists. While the growth In 
information systems activities as a result of NDEA Title X and ESEIA 
Title V is quite apparent, It Is not at all clear whether the data collected 
Is any aora useful to legislators now than It was previously. 

Interviews, with state legislators, as well as review of publications 
from several states,, indicate that most such publications are long on data 
and exceedingly short on even rudimentary analysis. Considerable data 
are published, but the types of data collected and the format of the data 
do not lend themselves to easy understanding on the part of policy-makers 
who do not have backgrounds in education, education finance, or statistics. 
The typical annual statistical report from a state consists of pupil 
accounting data, some minimal financial information, and general staffing 
data. Often these data are provided only by enrollment size groupings, 
l.e. »for schools having over 25,000 pupils, 10,000 to 2A,999 pupils, etc. 

Other Federal sources for the collection of education data 

Besides the two Federal Acts discussed above, other means for 
developing and improving their information systems are potentially 
available to states. We indicated earlier, for example, that a great 
deal of information about specific schools and school districts is supplied 
to federal program monitoring bureaus in SEA's. These data are rarely 
asalmilated with the recurring, general purpose data collected by SEA's. 

An example In New York State, certainly one of the most advanced states 



with respect to the sophistication and comprehensiveness of its information 
system, will Illustrate a pattern that is all ytoo common. The Office In 
the New York State Department of Education, responsible for administration 
of ESEA Title I projects, collects annueJ. data concerning the amount of 
Title I funds allocated to each school district in the state. One data 
item is the number of children from families receiving Aid to Families 
with Dependent Children (AFDC) payments.^ Such information concerning 
ESEA Title I is published annually by the State Education Department, but 
the riiimber of AFDC children — one of the few generally available indi- 
cators of poverty — does not make Its way into the State Education 
Department's Annual Statistical Summary. 

In addition to providing the kinds of data required by Federal 
statute for the administration of specific federal aid programs, only e. 
very few states have been particularly adept at using funds for administra- 
tion to collect information that la clearly and directly related to the 
needs of a comprehensive information system. New York State can again 
serve as an example. For a number of years prior to 1965, New York State 
had a small testing program for selected elementary grades that was made 
available to local school districts. With the advent of ESEA in 1965, the 
State Education Department used the Title I directions calling for 
evaluative Instruments for individual projects as a means of developing 
a statewide testing program. As a result, achievement tests in reading and 

^Approximately 90 percent of the Title I funds allocated to school 
districts in New York State are distributed on the basis of the incidence 
of AFDC pupils. 



arithmetic are administered annually to all third, sixth, and ninth 
graders in all public and most private schools throughout New York State. 
Each year the cost of malntalhlng the Pupil Evaluation Program has been 
borne by the statewide administrative budget for ESEA Title I, But again, 
this significant and important body of data has yet to be coordinated with 

the traditional materials’ in the State Education Department’s information 

- 1 

system. 

As a result of these practices, the Annual Statistical Summary of 
the New York State Education Department gives information about the 
financial condition of each school district, the number of pupils en- 
rolled in the school district, and comparative wealth of the district 
in terms of property valuation^ but in no way enables one to get a sense 
of the actual socio-economic condition of the population or the achieve- 
ment level of pupils in school districts. We might also add that 
additional information is regularly collected and published in other 
forms or available on computer printouts (post secondary patterns, drop- 
outs) but not Included in any pri:iille of schovol districts. Moat states, 
however, do not routinely collect such information. 



It should be emphasized, however, that the Bureau of Research 
and Evaluation in the New York State Education Department which ad- 
ministers the PEP Testing Program does analyze the results of the test 
on a community- type dimension. These analytical reports are produced 
annually and focus on the percent of educational dlsadvantagement In each 
stratum. Educational Dlsadvantagement is defined as the percentage of 
youngsters scoring below minimum competence levels, the 44th percentile 
on the reading and arithmetic testa. 



Suminary 



, State information systems have expanded and improved dramatically / 

in the past decade, largely as a result of the availability of Federal 
funds (NDEA Title X and ESEA Title V) . Great variations continue to 
/' . exist among states in both ability and willingness to provide the 

Federal government with data. ■ ■ 

A number of states are rebelling against information requests from 

T 

Washington citing duplications, lack of established need for information 

\ 

■ and the high cost of collecting information not routinely collected. 

^ The National Center for Educational Statistics (NCES) has made 

major efforts to improve data collection procedures in recent years 

I (since its inception in 1965). However, the Center is severely limited 

in that almost 90 percent of elementary and secondary education data 

j are collected by program mancgement bureaus of USOE, Office of Civil 

i Ri^ts (hew), Bureau of the Census, and the Department of Agriculture. 

1 

} Though interagency cooperation is improving, greater coordination is 

I 

I 

I in order. 

I 

S • 

I NCES has by far the smallest budget of all major statistical 

r ^ ag«incies in the Federal government. Given the pressing need for 

relevant and timely information and the multiplicity of problems 
associated with complete dependence upon state and local education 
agencies, the currant budget of $5.7 million is grossly inadequate. 



! 
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CHAPTER IV 



THE INTERESTS AND CONCERNS OF CONSUMERS OF EDUCATIONAL DATA 

In this chapter ve look at those who \ 4 se educational data. We 
will Identify the different kinds of consumers, comment on their 
particular concama and Interests, and suggest priorities for ordering 
the multitude of needs to be served. 



The Uses and Users o f National Data 
To suggest that needs of an Information system can be divided 

Into (1) policy needs and (2) management needs Is a somewhat dangerous 
exercise. Although legislators may be conaldered primarily as policy- 
makers, It is nevertheless Important to remember that Congressmen and 
Senators, In the exercise of legislative oversight, are vitally con- 
cerned with mana^enent activities of the executive branch of government. 
Conversely, Initiation of new ptjbllc policies as well as assessments of 
existing policies is not limited to legislators, but Is a natural out- 
come of the direct InvolvemeiTt In program management of public executives. 
Furthermore, Initiation and review of public policies often occurs at 
other levels of government and by such observers In the private sector 
as researchers, the press, foundations, private business, and groups of 
coheemed; citizens. Therefore, In examining the array of consumers of 
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educational data, we will focus on those concerns common to each 
classification of consumer, as well as on the differences in data needs 
among these groups.^ 

The following discussion draw.s upon three tiources of information, 
Flrat, during the pajt several months we have talked with a range of both 
consumers and iproducers of educational data: Federal and state legiala- 

tora, legislative staff, executive branch personnel in state education 
agencies and the United States Office of Education, and staffs of 
educational Interest groups. Second, we have examined the cosnants of 
respondents to a survey of data users ccrsducted for the U.S. Office of 
Education in 1970. Finally, we draw upon our several years of experience 
in working with and for policy-makers at local, state and federal levels. 

The concerns upon which we will focua are : 

Accuracy of data : How accurate are the data? What margin of 

error can be tolerated? 

1 

Time lines a t How important Is it that information be current? How 
great is the time lag between the year for which the data supplies and 
its publication? 

Comparability : How extensive are the problems Involved lu 

comparing data from one state to that from another? 

Projections : To what extent are consumers interested in 

projections of educational data for periods of several years? 

Analysis ; Do consumers want data to be analyzed or do they simply 
want the data made available in tablas in order to do their own 
analysis? Is there a concern about analysir? ?belng susceptibla to bias 
favorable to the political party in power? 

Readability of Publications : Should publications be presented in 

technical or lay^n's language? 



development of recommendations on the particular data items re- 
lated to these needs will be covered in the last chapter of this report. 
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National policy-makers; the legislative branch 

Congressmen, Senators, ttieir staffs and committee staff members 
place great emphasis upoi; the . timeliness of information. While 
statisticians and researchers know that only minor changes In given 

data will occur over a period of 2 - 3 years, policy-makers have little 

/ 

confidence In Information that is more than a few months old. Ideally, 
tliey would like to know "the condition as of last X 7 eek." As a result 
they have a strong tendency to seek answers to their questions about 
education directly from p'^raonal sources in Washington rather than 
relying on publications of the National Center for Educational Statis- 
tics (NCES) or other federal agencies that publish data about education. 
This behavior pattern occurs even when the information sought can 
readily be found In such well known publications as 'fetatlatlca of State 
School Sya terns." This Is not to say that legislators or their staffs do 
not turn to publications; rather. It is to say that given a choice, they 
are more likely to use the personal approach. 

With the exception of "Projections of Educational Statistics," 
the NCES publications tend to have time lags in data reporting of two 
and a half to three years. Legislators, usually laymen in matters of 
educational research, simply do not trust data that old. They are less 
concerned with the controlled and authenticated aspect of data which hare 
been processed by NCES than with the need to have current figures for a 
specific hearing or policy decision. Faced with such Immediate needs, 
they will often turn to such other sources as the National Education 
Association publications which provide useful, current estimates, such 
as the monograph "Financial Status of the Public Schools," or they will 



i 



get Sucli estitnates from other sources by telephone. 

A second major concern of legislators and legislative staffs is 
with the way in which data are presnAted by the Office of Education. 

Tlie lack of any analysis in OE publications reduces their information 
value. Since legislators tend to be lawyers rather than statisticians 
or educatbrs, and further, since they are busy men, they feel that they * 
have neither the time nor the ability to analyse data thewselvea. 

Analysis of published data thus becoaas a legislative staff function, and 
again the problem of expertise arises. Since the typical publication 
rarely relates criti.cal variables to each other within broad "policy 
issue'' categories, OE publicationu are difficult to iiae for the kinds 
of questions to which policy-makers need ^.awers. Moreover, one 
legislative staffer suggested that NCES needs fewer atatiaticlans and 
more artists, since legislative consumers require charts, bar graphs, 
tables and other visual techniques which bring out the tneaning and 
Implications hidden in the raw data. The clear implication is that 
more emphasis on readability would result in wider utilization of the 
collected data. 

The clear desire of Congresalonal policy-makara for greater 
analytic orientation in the publications of the U.S. Office of Educa- 
tion runs almost completely counter to the atf Itudes we find prevalent 
within the Office » One occasionally haars comrasnta about tha ntad to 
do more analysis or the intent to obtain staff to permit actual 
analysis in future years. More commonly, however, one gets the 
impression from O.E. personnel that the absence of analytic content 
in NCES publications reflects a clear policy originating in the upper 
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levels of the Office. Whether or not the latter view is accurate, its 
very existence as a widely held belief could well be sufficient to 
deter the needed reorientation in USOE publication practices. Lower 
echelon personnel are less inclined to initiate such reform in the face 
of what they rightly or wrongly regard to be an unfavorable clitnate for 

its success. 

In the absence of analyses, interpretation, or even categorization 
of data in OE publications. Congressmen, Senators and their staffs seek 
quick answers to questions through contacting knowledgeable persons. 

Many such queries come to staff members of the Office of 1-ducation, atod 
in their personal responses there is far less inhibition about inter- 
preting data than in official publications. Legislative policy-makers 
also frequently turn to others in the Washington community, such as 
professors, national staff personnel of organized educational interest 
groups, or those Congressmen or staff members who, over a long period of 
tine, have established themselves as particularly knowledgeable on past 

or current educational policy questions. 

Because they also want to know where the country seems to be 
headed with respect to important issues, legislative policy-makers 
have a strong interest in statistical projections and the closely 
related area of trends. NCES publications that extrapolate present 
de-velopments are often viewed as the most significant and useful 
publications of the Office. In fact, we found among our interviewers 
a feeling that projections would be considered more useful if they en- 
compassed additional policy issue areas. The implication for data 
collection, analysis and dissemination is that the routine publications 
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of the USOE should be based on a highly constant base of data which 
makes assessment of trends and projections more effective. 

National po l icy-makers: the executive branch 

For purposea of this discussion, executive branch policy-makers 
include staffs at the White House and the Bureau of Managmcnt and 
Budget, md top level executives at the Office of Education and Depart- 
ment of Health, Education, f.nd Welfare (HEW). Such policy-makers have, 
in general, primary concerriS similar to those of the Congresa, particularly 
in the case of officials of the Office of Management and Budget and the 
White House Staff: (1) fitting queetiona of educational policy into the 

context of overall domestic policy and (2) serving as waf.chdogs on HEW 
' and OE activitlca. 

While executives within HEW and OE are also concerned with long- 
term policy questions, their primary function is management which 
includei! current planning and evaluation ol existing Federal government 
policies and programs. Both groups of officials focus much of their 
attention on monitoring programs, data about which are not part of 
the routine collection, analysis, and dissemination activities of the 
Office of Education. For information about government programs in 
education, they rely upon specific reports by Individual program nanagars. 

For the more routine information requirements with respect to the 
condition and progress of American education, data needs of executlva. 
branch policy-makers often differ from those of legislative branch In 
that they are more Interested in accuracy and comparability than with 
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timelineaa. Though they arc. also concerned with the comprehensiveness 
of data about American education, such officials usually have specific 
questions about conditions in a particular state or in selected types 
of school districts. Because they can ask subordinates to analyze data 
as needs arise, the analytical content of OE publications is far less 
essential in their eyes. Although readability is less important to 
policy-makers in HEW or OE, those in the Office of Management ' and 
Budget and the White House compare with legislators in their desire for 
publications that are "readable.'.' On the other hand, since the inter- 
pretation. given to data may well have political Implications, they may 
tend to see analysis as appropriate only for in-house documents and 
consider it potentiall3r counter-productive to administration objectives 
if included in official publications. 

I 

Pcli cy-makers at state and local levels 

The National Center for Educational Statistics (NCES) consistently 
expresses a strong desire to gear itself to meet the information needs 
of states and local school districts. This avowed purpose of NCES 
actlvlcioB is .baaed on two closely j;elated realities. First, while 
Federal information noeda '^.enerally reflect broad educational concerns, 
local school districts and states have information needs about education 
that are often critical to the day-to-day operation of the public schools. 
Thus, the quality of state and local information systems will have a 
direct bearing on the quality of decision making that occurs at each of 
these levels. Second, NCES wisely recognizes that data submitted to 
the Federal government can be no better than that which was originally 




avallabJ.e at the level of the local school district and, where 
appropriate, the individual school building. 

The difficulty with meeting such a goal Is that it becomes all 
too easy to confuse the information required for intelligent policy- 
making at state and local levels with the realities of obtaining infer- ‘ 
mation for national pupposes. For example, the needs of states also 
include reducing the burden Imposed by the obligations to supply data 
to the Federal government. NCES can and has done much to meet that 
kind of need. On the other hand, there are few areas in which the 
Federal governi'ent could collect from, and then supply to, a particular 
state Information necessary to state level decision making that could 
not be done more efficiently, economically and effectively by the state 
Itself. 

State legislators, legislative staff, governors, and state 
superintendents of instruction have interests and concerns that are 
remarkable similar to those of policy-makers at the Federal legislative 
level. For example, timeliness of data la one vf the more critical 
conslderatlona • In addition, both analysis and readability are important 
factors to policy“raakora at state and local levels. In, the larger 
states, state education agencies have the capacity to provide 
analysis. In some additional states, this service is provided by 
researchers at the state university . However, to the vast majority of 
states, NCES publications would be considerably more useful if they were 
more analytical and readable. Our observations indicate that more often 
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than not, policy-makers at federal, state and local levels alike tend 
to turn to NEA publications more often than to NCES for inter-state 
comparisons . 

Another state-local need could be met by an analysis-oriented 
Federal Information system. Nationally collected, analyzed and 



ifisues that are largely Ignored by the education establishment within 
fi state. For example, questions concerning the equitable distribution 
of state aid are seldom dealt with directly by state education agency 
publications. Parents and other Interest groups must perform their 
own analysis of state data, often without expert assistance. Further- 
more, data are rarely available from other states In a form which would 
enable them to i^dce comparisons. The publication of such date on states 
centering about an educational Issue with broad national impllcfttlcvis 
can be Immensely useful In stimulating change. 

Probably the aspect of national data given top priority by 
officials at stateLand local levels is the comparability of Information 
among states. State officials must be satisfied that the information 
about their own state which appears In a Federal publication Is 



accurate and they must have confidence that Items are defined In the 
same way for each state with which they might wish to compare their 



Accounting, NCES has exerted strong leadership In this aspect. Better 
opportunity for comparability would exist today If more states ahd 
themselves adopted handbook procedures for record keeping. 



disseminated data would assist citizens who need information concerning 



own state. Through the development of Handbook II on Financial 
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It is our contention that NCES, overstates the importance of 
fulfilling the goal of meeting policy-making information needs of 
state and local school districts. The ability to make such inter- 
state comparisons is, in a sense, a federal bonus given to a state or 
local school district information system. The fundamental and critical 
decisions that must be -made by higher level policy-makers rarely rest, 
upon the specific information items available or structured for inter- 
state comparison; It seeu« to be much more useful as well as mote 
efficient for NCES to follow the suggeation that has been made by a 
number of representatives to the Committee on Educational Data Systems 
(CEDS): the Federal government should simply indicate to the states 
the data it must have from then, and pay less attention to crying to 
arrange data to solve state information problems.^ When tha specific 
Federal needs for information have been well served, the resulting 
availability of data for inter-state comparisons will serve local and 

state needs equally well. 

An advantage to this approach is that one can then separate out 
those needs or problems related to producing data critical to decision 
making in the Federal government from the specific information needs 
peculiar to individual states and local school districts. The Federal 
government can then address itself to procedures necessary for efficiently 
collecting data independent of programs such as ESEA Title V that are 
designed to strengthen state education agencies. Such efforts on the 

^Appendix A reports the analysis of a questionnaire to CEDS 
representatives. 
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part of the Federal government were discussed in greater detail in an 
earlier section of this report. 

Policy influencers; educational researchers and foundations 

i 

It has long been recognized that the foundation and research 
community can haye important impact upon public policy in the field of 
education, /ilthough they are in a private sector of public life, 
foundations and researchers typically aaintain a high dagrea of Inde- 
pendence compared to the constraints placed upon specialists within the 
education bureaucracy. An exception to this might be projects conducted 
specifically for government agencies, under conditions in which 

I 

publication of the research results is at the discretion of the oontrectlng 
agency. Nevertheless, many researchers under contract to governeent 
agencies, along with those coapletely independent of govemaeat connec- 
tions, have significant opportunities to initiate new policy ideas as 
well as to mal^ asaessments of existing governmental policy* 

Research into public policy questions, whether sponsored by the. 
Federal government, private foundations, or simply non-sponsored but 
university-baaed is, of course. Intended to Influence the course of 
public policy. Ifrdata about the questions being studied are not 
available from the Federal go/emment, the researcher must collect hla 
own. Since data collecting for research purposes Is always a hazardous 
undertaking at best, the Importance of having useful data available for 
such purposes serves not only the interests of the researcher, but 
ultimately the concerns of the government, and, in turn, the public at 



large. The number of research-oriented people contacted as part of the 
recent USOE User's Survey is indicative of the importance attached to 

this conununity of interest by the NCES. 

Researchers in general and educational researchers in particular 

have one interesting characteristic in common with lower level btireau- 
crats in governmental agencies. Both groups have a tremendous capacity 
to generate all sorts of interesting questions believed to be worthy of 
study,, One of the major difficulties faced by such agencies as NCES 
when reviewing the voluminous number of requests for data items to be 
included in routine surveys is to separate the data necessary for 
critical policy questions from those that are important and exceedingly 
interesting, but nevertheless, less critical. Indeed, one of the 
fundamental purposes of the major issue? framework that is the subject 
of Chip ter II df this report is to provide critsris by w 

can be made . 

Despite the fact that education-based researchers typically focus 
their efforts on the same set of policy questions as do legislative and 
executive branch policy-makers, there are marked differences in their 
major concerns. ' Whereas the policy-maker wants current data, the re- 
searcher is more concerned with the accuracy of data and thus is willing 
to accept data several years old with confidence that the pattern that 
emerges will shift only marginally over the ensuing period of time. 
Similarly, when it comes to state comparisons, the researcher wants to 
know with confidence that the reported data are comparable from one 
state to another. The researcher/statistician is Inherently concerned 



about the comprehensiveness of the data collected with particular 
Interest in the nature of a sample that is employed when universe data 
are not obtained. Researchers are generally not particularly Interested 
in projections made by someone else. But they do recognize the 
Importance of a strong data base from which one can make Judgments about 
trends and, in turn, projections about future patterns. 

Finally, the most fundamental difference between reaearchers and 
policy-makers or, for that matter, almost anyone else Intereated in 
education data, relates to their lack of concern about analysis and 
readability. Researchers want the data. They prefer to do their own 
analyses. Furthermore, when text Is supplied to a publication, they are 
more concerned with the thoroug^mess of the explanation and the scholarly 
approacll of the work In general than about the clarity of the presents- _ 
tlon. Information that la difficult to read is easily forgiven if the 
substance of the presentation is well ordered. 

The education industry 

Virtually all of the statistical bureaus within the Federal 
government have as one category of clients the business and Industries 
that operate in each of their respective fields. The Office of 
Education is no exception. Numerous suppliers of equipment, publishers 
of texts and other learning materials and, most recently, performance 
contractors rely upon statlGtlcs collected by the Federal government. 

The primary concern of education industries la with projections 
and trends for planning purposes. Furthermore, their areas of concern 



focus on currlciilum and minbers of pupils enrolled In various 
curricular programs. They need to know how many youngsters are en- 
rolled in various subjects and xchat new kinds of curricula are being 
developed. Such information enables the businessman to plan ahead for 
bf/th the kinds and quantities of materials he will develop. 

Thus the education industry is primarily Interested In the data 
Itself. Little concern Is expressed about analysis or readability 
since industries employ their own personnel to analyze publications by 
national agencies . The typical businessman prefers to make his own 
judgments about the Implications of statistics and their relationship 
to his own particular needs. 

Educational int e rest groups 

There are a number of special Interest groves in education which 
are organized : nationally and have particular interests In the condition 
and progress of education. Those generally recognized aa the major 
groups are as follows : 

1. National Education Association (NEA) 

2. American Association of School Administrators (AASA) 

3. Classroom Teachers Association (CTA) 

N . 

A. National Association of Secondary School Principals (NASS?)- 

5. Other affiliates of the National Education Association 

6. American Federation of Teachers (AFT) 

7. National School Boards Association (NSBA) 

8. National Catholic Education Association (NCEA) 
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9. National Association of Independent Schools (NAIS) 

10. American Council or. Education (ACE) 



11. Council for Basic. Education (CBE) 

In addition, national organizations such as labor unions, civil 
rights groups such as the NAACP, and private enterprise groups such as 
the Council for Econonu.c Development and the Chamber of Commerce, have 
an interest in Amerlcatii education with resultant needs for information. 

Information needs of interest groups directly related to educa- 
tion are two fold. First, each group has a political role to play for 
its own constituents concerning negotiations for employee benefits or 
activities such as aid to private and parochial schools. The differing 
Interests and proapectlves of these groups within the political milieu 



often put them in competition with each other. On the other hand, all 
special interest groups concerned with education have in common a second 
area of Interest. That is the improvement of education throughout the 
nation j with particular focus in recent years on Increased Federal aid 
for all aspects of education. Such common Interests have been drama- 



tically Illustrated in the ability of most Interest groups to work to 

r 

« 

gether in the Committee for the Full Funding of Education Programs, a 
lobbying coalition created to Influence legislators to appropriate 
fimda for existing programs at the level of original congressional 
authorizations. Such activities reflect the common Interest that all 
education groups have in the fundamental policy Issues facing the 
nation as a wholu. 
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Thus one can view the information requirements of special 
interest groups with respect to the major public policy issues as being 
synonymous with those of legislatures. Indeed, effective lobbying will, 
in large measure, be dependent upon a common understanding between 
legislators and interest groups about the nature of the problem raised 
by a specific policy Issue. And common understanding is promoted 
through the use of a common data base for examining the nature of a 
problem. Those publications of the NEA that , deal with characteristics 
of the states with respect to education are excellent examples of data 
that have been collected and analyzed In order to Influence policy 
making on issues of broad national concern.^ 

When It comes to fulfilling the Information needs that relate to 
the unique concerns of individual interest groups, ve suggest that when 

those needs can be met with no additional expense to the Fedatal govern- 

a 

ment and no additional burden to states and local school districts, such 
data should be included In USOE publications. 



It must be pointed out that the NEA undertakes the collection and 
publication of information of national Interest simply because the U.S. 
Office of Education discontinued publishing such data In the early 1960's 
The need for such information was felt to be Important enough that the 
NEA decided on Its own to fill the gap. Numerous policy makers at bpth _ 
federal and state levels have Indicated to us that they turn Co_NEA publl* 
cations, particularly the "Ranking of the States," for nationally 
collected and published educational information. On the other hand, 
the U.S. Office of Education continues to be reluctant about ranking 
states on any of the Information Items that It currently collects and 
publishes. 



Summary 

The data collection, analysis, and dissemination program of the 
U.S. Office of Education has been designed to serve a multiplicity of 
needs. Even when we limit our definition of the program to information 
that is routinely collected about elementary and secondary education, 
we. continue to see that there are several categories of data consumers 
that have interests and concerns about the data that are in conflict. 

Our purpose in the foregoing section was to examine . those interests and 
concerns of the various categories of users independent of the specific 
policy issues for which each category would like information. 

The order in which we discussed the interests and concerns of 
categories of users represents the priorities that we believe must be 
assigned to developing a long range, comprehensive program for 
collecting, analyzing, and disseminating information about education. 

To the extent that the needs of any one category of consumers are 
adeqi\ately met, they do not Include those who should be receiving top 
priority, namely, legislative and executive branch pollcy-naikers. 

The needs of policy-makers are not met for three reasons. First, 
there is a critical lack of policy orientation in the data that are re- 
ported and, in large measure, collected. Second, reporting of information 
is almost completely devoid of analytic content. (This is a basic reason 
why current USOE data activities meet the needs of lower priority users 
more effectively than policy makers.) Third, USOE publications are not 
sufficiently readable and useful for policy makers who are neither 
statisticians nor educators. 
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The remaining two chapters of this Heport are directed at providing 
strategies for developing an information system designed for legislators 
and officials who review and formulate educational policy. In the next 
chapter an educational finance, policy framework for gixiding development of 
/ such a system is discussed. A series of recommendations for dealing with 

^ the shortcomings summarized above and with the data collection, analysis 

and dissemination program of the USOE are developed in the final chapter. 




CHAPTER V 
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A POLICY ORIENTED FRAMEWORK FOR INFORMATION 
ON THE FINANCING OF, AMERICAN PUBLIC SCHOOLS 

The most important criterion for evaluating the adequacy of 
available Information on educational finance Is how well such data 
illuminate and explain the major Issues of national education policy. 

Specifically, a program of data collection, analysis and 
dissemination must begin with the critical question: data for a^ 

about what? Accordingly, we believe that meaningful improvements in 
the statistical services of the United States Office of Education can 
occur only If data needs are measured against a consciously and care- 
fully articulated framework of educational policy Issues . This 

chapter will discuss one such framework. 

Since the focus of this study Is school finance, the relevant 
issues are those In which fiscal considerations are central. Because 
our sponsor Is a Presidential Commission charged with preparing 
recommendations of a substantial and fundamental nature, our analysis 
is intended to take account not only of those specific policy issues 
which are before the nation at present, but also those broad policy 
concerns that will be of Importance throughout the decade of the 
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seventies . 



Our purpose, then, Is to develop a policy framework that Is 
sufficiently comprehensive to cover the range of Important questions 
that policy-makers ask, and explicit enough to suggest data that 
can provide the answers they need. We do not claim that the agenda 
of Issues within the framework ha s a unique validity. It Is, however, «. 
designed to organize the collection, analysis and dissemination of 
information on issues which It is generally agreed will have national 
significance for some time to come. Major categories of the 
framework organize Information around four fundamental questions 
that effective governmental policy must address If it is to cope 
with the complexities of school finance: 

1. What is the level and composition of both the need 
and the demand factors for various kinds of educa- 
tional services, both at present and in the fore- 
seeable future? 

2. What will be the cost of satisfying . those needs 
and demands? 

3. How equltable--under whatever definition of equity 
might be posed — is the present distribution of 
educational services? And how equitably distributed 
Is the burden of paying for those services? 

4. What is the fiscal Impact of Federal aid programs 
on school districts. Also, what is the Impact 

on learning of educational progrems in general and 
Federal aid programs particular? 

Clearly, we have more precise and complete information 
available in some of these areas than in others* Appendix B of 
this Report lists the sources of available data which bear on these 
questions. In the present section of this Report, however, we 
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concern ourselves with an explanation of the policy framework 
against which the adequacy of data must be judged, examining in 
detail the issues that are subsumed under each of the fundamental 
problem areas noted above . 

1. The Demand for Education 

Changes in the need and the demand for education come about 
as a result both of changes in the population and in the mix of 
educational services that are desired by consumers. We are not 
suggesting that a rigid deterrainiam controls the shape of American 
education, nor that we can ascertain with precise accuracy the 
patterns of future school populations or the shifts in preferences 
for different kinds of education. But we believe that with the 
development of a policy oriented information program, far greater 
knowledge about the components of such changes . could be made 
available to those who influence, formulate, and Implement policies 
for education. Specifically, greater knowledge about the 
dimensions of need and demand factors in education would permit 
legislators and executives to plan more sensibly for the future. 

1.1 Changes in the population 

There are two dimensions to concerns with population changes. 

The first deals with the numbers. How large is the population to 
be served and where is it located? Second, what are the characteristics 
of the population to be served by education in general and public 
education in particular? Analysis of the needs of public school 
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pupils will focus on enrollment rather than the population as a 
whole. 



1.1.1. Gross population trends 

What Is the pattern of population growth? In order to 
develop programs for the training of personnel or for the provision 
of facilities, policy-makers should know what the volume of future 
population is apt to be and where It Is likely to be located. Baby 
booms, for example. Imply a need for Incentives to draw resources 
and personnel Into early childhood and elementary education, with 
lower short term priority for secondary and higher education but 
predictable Implications for the future. 

t 

What shifts In population characteristics are occurring among 
city, suburban and rural areas? Changes In the composition of central 
city, suburban, and rural populations will have direct relevance 
to the need for and the design and cost of educational programs. 
Policy-makers at the national level should be aware of regional 
growth patterns as well as trends In city-suburban-rural population 
shifts. Within states, of course, the questions raised by those 
who plan the future of education are more specific as they seek to 
pinpoint the planning of training programs for given areas and 
facilities. Clearly, general population data from census collections 
should he available about school district =unlts, rather than just 
for municipal jurisdictions as Is presently the case. 



1.1.2. School-age population and enrollment trends 

What Is the patt ern of change In pre-klnderearten to grade 12 
enrollments among types of school districts and states? Of more 
immediate interest than long-term population projections are the 
obsenmble trends in the school-age population. Relatively short- 
term (five to fifteen year) school-age projections may be made for 
states and regions with considerable confidence. Based on 
population birth to five years and upon existing early-grade enroll- 
ments, policy-makers at all levels of government should routinely 
know the demands that will be placed upon educational resources by 
virtue of pupil numbers at different grade levels, both now and 
for the near future. Clearly, questions of this nature require 
estimates that must combine relatively hard data based upon the 
existing population with estimates that have an implicitly greater 

degree of uncertainty, for instance the patterns of mobility and 
school-leaving age. 

At present, school enrollment data are collected according 
to a variety of measures that vary among states: fall enrollment, 

average daily membership, average daily attendance. Each measure 
has several possible variations. labile in the aggregate differences 
xn the totals among the various measures may he rather small, 
amounting to only a few percent, the impact on the enrollment picture 
of particular kinds of school districts may be significant. Areas 
with large proportions of poor or minority group pupils have higher 
absentee rates, so that attendance measures tend to understate the 



school population to be served. For example, in New York State It 
was found that changing the technique for counting pupils from 
the average daily attendance basis to an enrollment basis would have 
raised the pupil count in New York City sufficiently to Increase 
its share of state aid by nearly fifteen percent.^ Policy-makers 
concerned with providing aid to districts with attendance or 
dropout problems ought to be provided data which permit them to 
monitor these concerns. 



Changes in the nature of the demand for education 
Ascertaining the need for school services requires more than 
simply knowing how many pupils will be located where. Demand 
changes will reftect- a relationship to the patterns of the years of 
schooling required by our society, oa both pre-kindergarten and post- 
secondary levels. Preferences for private and parochial education 
will continue to shift and will have Immense Impact on the demands 
made on the public schools in some localities. Consolidation of 

school districts and decentralisation of large districts crests 
their own sets of demand problems, requiring that such information 
be available. Finally, changes in the characteristics of 
communities discussed above, as well as shifts in student and parental 
preferences, suggest that changes In curricular programs and school 
services will form another set of demands. 

^Joel S. Berke, Alan K. Campbell, and Robert J. Goettel, 
Financi ng Equal Educational Opportunity; Alternatives for State 
School Finance , (Berkeley: McCutchan Publishing Corp.), forth- 

comlng Spring of 1972, Chapter IV. 



1.2.1. Years in school 

What patterns are emerging with respect to years In school? 
Patterns of required and desired years of schooling are shifting. 

The most obvious shift may be downward, as kindergarten becomes 
more universal and as increasingly larger proportions of the 
population express a demand for early education. Conversely, 
school-leaving age may extend upward, with the demand for the 
availability of junior college facilities and open enrollment programs 
becoming more widespread. Will pupils and their parents increasingly 
seek more, leeway in the period of life devoted to formal schooling, 
requesting, perhaps, the option of:. Interrupting schooling for two 
or three years during late adolescence for experience in the private 
economy, public service, travel, or self-defined learning situations? 
And will a society that Is becoming more dependent upon technology 
require Increasingly more training and re-tralnlng experiences 
for economic pu^oses? Will shorter working days, weeks, and years 
lead to more educational opportunities and for leisure pursuits 
throughout the life span? Policy-makers cannot intelligently predict 
future demand without seeking some Indicators of approaching changes 
In the nature of the present demand for education. 

1.2.2. Noh-publlc education 

What is the Impact on public education of changes In private 
and parochial school enrollment patterns? Preferences for public 
versus private education are undergoing change. The closing of 



numerous parochial schools, for example, has received considerable 
attention because of the obvious and direct impact on public school 
finance in general and certain school districts in particular. 
Fortunately, techniques developed by researcliers ior the President's 
Connnission on School Finance and the New York State Commission 
on the Quality, Cost and Financing of Elementary and Secondary 
Education have provided some of the methodological tools necessary 
for dealing with shifting preference patterns for non-public 
education. 

Hill the awakening desire of parent s for differentiate d 

educational programs and "better teaching" lead to a shift in enroll- 
ment to varied types of non-public schools? Just as significant 
numbers of Catholic parents and students appear to be re-assessing 
their need for parochial education, other segments of society are 
looking to alternative models for schooling beyond those offered 
by publir. soliooJ distri.cts. SrreeL acadera i.e;-; , i. rou scliools and 
industrial training programs are examples of fledgling but potentially 
significant innovations. Proponents of voucher plans have provided 
a possible vehicle for funding such programs. We have every 
reason to believe that public interest In alternative schools will 
generate an increased demand for state and Federal government 
intervention in the 1970's, a demand which in turn neeessitates an 
available source of reliable information for Federal decision making. 
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1.2.3. Changes In school district organization 



What changes that have fiscal implications are occurring in 
: the organization of school districts? The long-term trend toward 
consolidation of small districts has been well documented, but we 
must continue to devote attention to the changed dimensions of school 
-district reorganization. Decentralization of large school districts 
;,;raay have significant impact in future years on patterns of admin- 
istration and governance.' Regional approaches to the delivery of 
school services which provide costly programs for vocational 
education or education for the handicapped through cooperating units 
are not well accounted for under existing data collection systems. 

If the trend toward regionalization continues, as many state 
programs suggest, policy-makers at all levels will be asking more 
questions than can currently be answered about the prevalence, cost, 
and desirability of supporting and encouraging such developments. 

1.2.4. Changing curricular programs 

What changes are occurring in the content of education? 

Obviously, changes of the type noted above will also bring 
with them demand not simply for more, but for different educational 
programs and facilities. The increasing proportion of low Income 
populations in particular areas implies a need for Increased and improved 
vocational and career training programs, as well as compensatory education 
programs in varying age patterns (i.e, pre-kindergarten) intended 
to overcome obstacles to learning that are environmental In origin. 
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Recent studies have repeatedly demonstrated that low school achievement 
levels can be statistically predicted from observation of such 
societal variables as parental education levels, number of schools 
a child has attended in the last few years, and the proportion of 
children living in overcrowded housing. Policy-makers at all levels 
of government may come to provide educational programs designed to 
react to educational indicators of that kind. If they do, increasingly, 
broader and more sophisticated data will be required by educational 
policy-makers. 

* * It 

In short, then, one major area of policy concern that wa would 
suggest as appropriate for organizing the collection and presentation 
of educational finance data is the level and composition -of the shifts 
in need and demand for educational services. The data needed to 
assist policy-makers in that area Include population treads, school- 
age enrollment trends, changes in the nature of the demand for 
education stemming from such things as growing interest In early child- 
hood and career education services / new ways 6f organi.zlng schools, 
and differing patterns of choice for private as well as public 
education. 

2 . Fiscal Dimensions of the Demand for Educational Services 

Having examined questions related to the volume and the 

varieties of educational services, we turn next in developing a policy- 

\ 

oriented framework for an information system to the costs of such 



ser\rlces. Focus in this section is on the fiscal Implications 
of the demand and need Issues discussed In Section 1. Current 
expenditures and- revenues must be examined In terms of the extent 
to which current needs are being met. Proj^ectlons for the future 
Indicate possible Increases In costs of services and the ability 
of revenue systems to yield the funds to meet such costs. While 
the focus Is prime rlly on education, recognition Is given to the 
fact that education finance functions within a framework of public 
finance. Thus one Important Issue become^ to what extent do 
demands for non-educatlonal municipal services affect the capacity 
of local jurisdictions to devote funds to education? 

2^1 Levels of financial support 

Concern here Is with expenditures and revenues for education. 
Three fundamental questions arise. 

2.1.1. The costs of educational services 

What are current expenditures In various types of school 
districts and what will future services require for their support? 
IrOUntlng the costs 1s clearly the most basic of fiscal responsibilities 
N&tlonal policy-makers should not only be provided with total educa- 
tloral costs, but they must also be able to identify conparatlvf iucpend 

'*■■■■ ■ ■ ■ . _ r 

Iture levels between states and among different kinds of pchool 
districts. In addition, It is becoming Increasingly apparent that 
Information about comparative expenditures among Individual schools 
within School districts Is also Important for local policy-making 
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although at the national level it is necessary only to have sample 
data of this nature. Comparisons, however, require common units, 
such as expenditures per pupil in average daily attendance or in 
enrollment, and commonality or uniformity must also apply to the 
expenditure units. For example, expenditures in school districts 
which pay for retirement costs from their own current monies cannot 
meaningfully he compared to districts in which the state pays for 
such benefits. 

Costs of different types of educational services should also 
be available. Starting at the most basic level, policy-makers should 
be able to tell what proportions and levels of expenditures are now 
allocated to schools with different pupil population characteristics, 
as well as observing such differences among elementary, intermediate 
and high schools. And in planning for the future, school executives 
should be able to estimate the per pupil cost of programs which 
emphasize, say,' early learning or vocational education. Changes In 
population patterns, in program preferences, and in school organiza- 
tion should all be amenable to at least rough cost estimates to guide 
the development of finance policy. In the present as well as in 
the future, the developers of school finance policy at the national 
level should have available to them indices of the comparative cost 
of purchasing similar educational aervlces in different regions of 
the country. Although the self-relnforclng nature of such cost 
differentials has thus far discouraged the development of suitable 
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Indices, clearly such information Is of critical importance to the 
formulation of any policy that calls for a significant Increase in 
Federal aid. A variety of possible approaches should be investigated. 
An expansion of the Department of Labor’s Consumers Price Index (CPI) 
to more Standard Metropolitan Statistical Areas for this purpose 
deserves serious consideration. 

2.1.2. The revenues available for educational services 

What are the sources of revenues for education, and what growth 
can be expected? Public education is currently supported by revenues 
from local, state, and federal sources. I'jocal funds provide more 
than half the total; states furnish more than 40 percent; and the 
Federal government supplies approximately 7 percent of eleraentary and 
secondary school revenues. Intelligent fiscal planning requires that, 
to the degree possible, revenue yields be estimated. National 
policy-makers should have information from which to understand trends 
in state and local financing and gear Federal programs to overcome 
soft spots in the fiscal capacity of those units or to encourage 
greater effort, depending upon Federal policy preferences. Data useful 
for these purposes require equalized assessment values for property 
that can be taxed by school districts and states; estimates of ftunlly: 
Income by school districts and states; and other such yardsticks of 
ability to pay. As revenue patterns shift from heavy reliance 
upon local property taxes to statewide, more broadly based taxation^ 
implications of such shifts must be apparent to those who plan the 



the nation's educational finance. 



2.2. Competing non-educaitlonal demands 

To what extent do demands for non-educatlonal municipal 
services affect the fiscal capacity of jurisdictions, both state 
and local, to devote funds to education? The deteimilnatlon of 
revenues available -for education at all levels of g;ovemment depends 
In large degree upon the competing demands for other public services 
that are made upon the same tax base. For example, In detenninlng 
the fiscal capacity of school districts and states, rarely is 
consideration given to the extent to which expenditures for non- 
educatlonal services in local municipal jurisdictions that over- 
lap school district boundaries reduce the affective capacity to raise 
revenues for education. Two districts— -or states— '*^th equal tax 
bases are not necessarily equally able to provide funds for education 
If one of those districts or states must provide more extensive 
police, fire, public health, transportation, and welfare services 
out of that same tax base. Data should be available to permit 
the formulation of Federal and state aid policies that recognize 
that education finance Is only one of several dimensions of public 
finance. 

* * * 

In short, the second major division of our framework organizes 
data related to the costs required to meet the educational needs and 
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demands discussed In the first section. It suggests that policy- 
makers ought to be able readily to match services to costs and to 
have guidance In determining what changes In patterns of educational 
resource allocation will be required. 

3. Questions of Equity 

In allocating public resources, the questions that must be 
considered are not only those of needs and costs, but of equity 
as well. How fair, public policy-makers ask. Is the distribution of 
(1) the educational resources and (2) the burden of paying for those 
resources? Certainly concepts of fairness differ, but the Information 
needed to answer questions of equity Is applicable to any one of a 
number of definitions. We propose a framework for examining equity 
In school finance that will suggest the data required to answer the 
more commonly accepted conceptions of equity. 

Equity In the distribution of resources: who bene fits? 

Let us look first at equity— or equality of educational 
opportunlty~ln regard to the pattern of allocation of resources. Two 
competing values are fairly widespread: first, that all public 

school pupils ought to have essentially equal resources; and second, 
that resources ought to be matched to educational needs In order to 
produce essentially equal learning outcomes. Under either approach, 
one should know the pattern of resource distribution— state by state; 
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district by district; school by school; in rural, suburban, or 
central city districts; by racial groups; by income classifications; 
and by wealth in terms of property value. What are the disparities 
between educational resources in one jurisdictional unit and those 
in another? To what factors do those disparities relate? 
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3.1.1. Dollar allocations 

To what extent are local school district expenditure levels 
a function of local wealth rather than the wealth of the state as 
a whole? How equitably are dollars for education distributed 
among states, school districts and schools? What are the effects of 
state systems of school finance upon expenditure levels of local 
school districts? Expenditures for education should be examined 
within states in terms of wealth, income and the. distribution of 
handicapped, vocational and disadvantaged students. Do expenditure 
patterns match the values and purposes Intended by legislation? Are 
f^^®P^^^bies systematic? What kinds of students seem to be benefiting 
most? Such questions can and should be asked about dollar 
allocations of educational expenditures. 

3.1.2. Service allocations 

How many and what quality teachers, counselors, curricular 
offerings, supplies, and facilities are available to whom and how 
wide are the variations? Most state aid systems are based on 
expenditures per pupil as the measure of fiscal need. A few, however. 
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use classroom units or pupil/teacher ratios to determine fiscal 
need. But the differences in the cost of providing comparable 
services among districts are of importance to almost all state 
systems. Thus if we bypass dollar allocations and focus on the 
distribution of services among schools or school districts, a 
somewhat different picture of equity often emerges. In short, 
some districts si well as states spend more for education and tax 
themselves at higher rates, but still fail in their attempt to 
provide services comparable to distrlcta or states that spend less 
or do not make as great an .effort. Information about such conditions 
is critical to the formulation of effective public policies designed 

to promote greater equality of educational opportunity . 

Such concerns are at the root of equal educational opportunity 
For those to whom the match of resources to need level is central 
to equal educational opportunity, the socio-economic characteristics 
of pupil populations and the achievement levels of those students 
may be considered Indicles of fairness , In the allocation of 
educational services. 

3.2. Equity in the distribution of costs ! who pays? 

Competing concepts of equity in taxation exist as clearly 
as they do for notions of equal educational opportunity. Whether 
one believes that costs should be related to benefits received or 
to the ability to pay, policy-makers want to know the comparative 
fiscal capacity to support, education among Jurisdictions. 
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3^2.1. Fiscal capacity 

^ To what extent are tax burdens related to the ability of 

states and school districts to raise revenues for education and 
other services? Fiscal capacity Is open to varying definitions 

5 ' and no single approach should be examined exclusively. Clearly, 

! however, It will Involve property values where local educational 

' > 

I revenue raising Is largely dependent upon the property tax. On 

the other hand, citizens pay taxes with Income, and the wealth 
of a community measured In terms of property values does not 
always match their actual ability to pay. Income levels, retail 
sales, manufacturing volume, are factors that can be examined. 

The relationship between taxes and ability to pay raises 
other questions about the financing of public education. When the 
state and local tax system Is taken as a whole, where does the 
burden fall? Is the system progressive, proportional or regressive? 
National policy-makers need to know how states differ on such 

I questions If Federal aid policies are to be designed to encourage 

i •' 

f 

i reform In state finance systems. 
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3.2.2. Tax effort 

How much effort do states and local school districts make to 
support education and other municipal services? Fiscal capacity — or 
its converse, fiscal need — Is one aspect of equity, but equally 
Important to many people who judge the fairness of the distribution 
of the costs is the question of the degree of effort being made by 




a community from Its ovm resources. In the recent school finance 
cases In California, Minnesota^ and Texas, courts concerned them- 
selves not merely with whether wealthier communities were able to 
provide higher quality school services, but they focused equally 
upon the question of whether wealthier communities were able to 
provide higher quality ser/lces with lower tax effort. Thus 
equalized tax rate Information becomes critical, as well as the 
relationship pf tax burdens to such other measures as personal 
Income. While the courts have not at this writing resolved that 
question directly, policy-makers in other branches, and possibly 
the courts themselves, may want to ask themselves precisely what 
measure of effort is really the raop/c realistic. It may be that 
tax rates converted to proportions of Income taxed for the schools 
Is a more appropriate approach, or else It may be that the total tax 
effort — for schools as well as for other public purposes — la a more 
appropriate test for certain kinds of school districts. In any 
event, national policy-makers ask a variety of questions about the 
effort which both states and local school districts expend on 
raising revenues for education. 

* * * 

In sum, then, questions of fairness are considered by citizens 
officials, educators, and Judges as they make determinations about 
state educational finance systems. Those questions relate to the 
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equity with which wc distribute services for education and the coats 
of paying for those services. Such questions are the substance of 
the third division of our policy framework. 



L. The Impact of Educational Programs 
While the policy concerns discussed under the previous three ' 
:ategorles api ear to be of consuming Interest to the policy-makers 
,e have contacted In the course of this study, and In the course 
sf our other professional activities In the area of educational 
finance, one set of questions emerges as of paramount Importance In 
the minds of many citizens. What Impact are current programs 
having and would there be any different impact if financlar Invest- 
ments In educational programs were Increased? Such questions ate 
covered In this last category of our policy framework. They are on 
the one hand questions related to the tracing of fiscal allocations 
for education and their Interaction with finance programs of other 
governmental levels, and on the other hand they are questions which 
relate to educational evaluation, namely the outcomes In the quality 
of “-ducation of the various government sponsored programs. 



4.1 Fiscal impact 

Who haneflta from Federal a id to education? To what extent 
Is the allocation of Fedetal aid related t o mea sures of fiscal and/p ^ 
.s„cstlons1 need? Perhaps the most distressing obse,rvatlon to be 
made about data gaps In the educational Information system Is that 
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after many years of Federal aid to states and local school diptricts 
and. In particular, more, than six years experience with the 

Elementary and Secondary Education Act of 1965, national level policy 

X 

makers are still largely uninformed about "who benefits?" 

This Is particularly surprising since oae of the primary purposes v 
of ESEA as well as other Federal programs is to improve the fiscal 
condition of school districts through such aid. Therefore, one of 
the more pressing information needs at the national level Is to 
collect, analyze, and present in a concise, coordinated, integrated 
and understandable manner, reliable answers to questions dealing 
with the flow of aid to school districts, schools and specific 
programs. Given the present "state of the art" in this area. Congress 
men and Senators will In all probability be asked to make far- 
reaching decisions about new Federal aid-to-education programs with 
exceedingly little information about the operational outcomes of 
present policies. For example, once one begins to ask questions 
about specific kinds of Federal aid, l.e., ESEA Title II or NDEA V, 
information about the flows of such aid is unavailable. Since 
different Federal aid programs typically have different purposes. It 
is critical that policy-makers know the extent to which the funds 
are getting to areas where the original purposes for which aid . 
was given can be served. 

Adequate information about patterns of Federal aid flows 
would Indicate what kinds of school districts and schools get which 

^For a report of efforts by the Policy Institute, Syracuse 
University Research Corporation to disentangle problems related to 
this question see Stephen K. Bailey, Joel S. Berke, Alan K. Campbell, 
and Seymour Sacks, Federal Aid to Public Education; I^o Benefits? 
Select Committee on Equal Educational Opportunity, United States 
Senate, April, 1971. 
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kinds of aid. Also, what kinds of services or activities character- 

: 

I ize expenditures? To what extent does the flow of Federal aid 

I compensate for or contribute to the inequities of a state’s finance 

' ^ system for education? How effective are state education agencies 

in coordinating and Integrating Federal aid programs? VJhat are ' 

I the patterns of allocations for non-USOE administered funds 

i- ' ■ 

i.e., Office of Economic Opportunity, Department of Agriculture? 
Clearly, current practice on the part of the USOE and state education 
agencies is to account for the expenditure of funds, not to provide 
information about such expenditures that relate to broader public . 
policy issues. The filling of this gap deserves top priority 
attention within the Federal government. 

4.2 Educational Impact 

Do additional resources In general, and Federal aid funds 
In particular, improve learning? Under what conditions does money 
make a difference? These questions are probably the most frequently 
asked by public officials charged with formulating educational policy 
as well as by citizens who are constantly asked to . pay higher taxes 
to support education. We are doubtful that such questions can be 
adequately answered at the present time, but the great importance 
that policy-makers attach to the need for some indication of positive 
payoffs from the current financial investment In certain kinds of 
education aid programs, must be reflected in any comprehensive 
educational information system. It should be noted, of course, that 
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there exists no consistent data to indicate that positive payoffs 
are not occurring. 

One clear way for the public to begin to get a sense of the 
condition and progress of learning in the United States la for the 
USOE to integrate information acquired from a variety of sources 

S 

about the current educational attainment of the population. This 
implies data about achievement teat results » college attendance 
rates, drop ovc rates, employment success, and years of schooling. 
Reaction to the National Assessment Program and the alow but sure 
growth of state assessment programs are promising indicators that 
resistance to finding out "how we are doing" la diminishing. Hope- 
fully, considerable attention and money will be devoted by the 
Federal government to accelerating the development of these activities. 
But another component of this Issue area holds less promise. 
There Is probably very little chance In the near future of producing 
significant benefit-cost analysis of alternative educational programs, 
and strategies to Influence the course of public policy. Therefore, 
a comprehensive FedCiral government Information system In education 
should not yet attempt to answer benefit-cost type questions. 

Rather, the responsibility for dealing with such questions should 
rest with the National Institute of Education (NIE) until the time 
that results of such analyses can be gerierali -5ed for applicability 
to broad based educational programs. In the meantime, the USOE can 

and should extend cooperation and support to NIE efforts to shed 
more light on this subject. 
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Sununary of Major Issue Areas 
In the Education Finance 
Policy Framework 




1. The Demand for Education 

1.1 Changes In the population 

1.1.1. Gross population trends 

1 1.2. School-age population and enrollment trends 

1.2. Changes In the . nature of the demand for educatlor . 

1.2.1. Years In school 

1.2.2. Non-public education 

1.2.3. Changes In school dlstrl 9 t organization 

1.2.4. Changing curricular programs 

2. Fiscal Dimensions of the Demand for Educational Services 

2.1. Levels of financial support 

2.1.1. The costs of educational services 

2.1.2. The revenues available for educational services 

2.2. Competing non-educatlonal demands 

3. Questions of Equity 

3.1. Equity In the distribution of resources: who benefits? 

3.1.1. Dollar allocations 

3.1.2. Service allocations 

3.2. Equity in the distribution of costs: who pays? 

3.2.1. Fiscal capacity 

3.2.2. Tax effort 
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4« The Impact of Educetlon Programu 
Ail Fiscal Impact . 

A 1 2 Educational Impact 



! 
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, CHAPTER VI 

SUMMARY Aira RECOMMENDATIONS 

The previous five chapters of this report have been addressed 
to Identifying the problems of providing useful Information for 
those who formulate and evaluate educational pollcyi particularly 
education finance policy, at the national level. The system of 
collecting, analyzing and disseminating data has been examined with 
particular emphasis on the most glaring shortcomings and anomalies In 
that system. We have examined and. catalogued both the availability and 
the usefulness of Information on the Important questions on the nation's 
educational agenda through Intervletrs, questionnaires, and staff 
analysis. We have met with local, state, and national officials of 
both executive and legislative branches, and have studied reports 
of previous panels which have looked into the information gap in 
elementary, secondary and higher education. As a means of judging 
the usefulness and organization of educational data, we developed a 
framework for policy analysis. 

Suanary 

On the basis of those research activities, our major conclusion 
is that the present system of educational information falls to aarve 
the requirements of those ^dio need tlamly, reliable and relevant in- 
formation about the nation's educational problems. From the pollcy- 
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makers viewpoint, this failure has four critical dimensions: 



1. Information ia not organized and presented within 



' and about what? 

2. . Information that is collected and disseminated is 
rarely analyzed. As a result, USOE information 
typically Is presented according to the 
alphabetical order of the states or the enroll-' 
ment of school districts, two characteristics 
which usually have little relevance to the major 
issues facing the nation. 

3. The format and presentation of the information 
as well as long delays In publication discourage 
use by policy-makers. 

4. Numerous gaps exist in the availability of data 
required to answer questions relative to the 
education agenda In the 1970 's. Such gaps occur 
for three reasons. 

a. Suitable comparisons from district to 

district or state to state are often not available 
in any fonn. Exa^les Include pupil achieve- 
ment data, cost benefit data, and "needs" 
data in basic instructional areas. 



a policy-relevant framework. There is little 



indication that federal education data collection 
begins with the most basic of questions: data 




106 - 



b. Data available for some aggregations of school 
districts, municipalities and states are 

not available for other aggregations or levels. 

This is one of the principal reasons why it Is 
so difficult to relate fiscal data about education 
to ..data about other state and municipal services. 

c. To be useful to policymakers an Item of 
information nmst be presented in relationship 

to another item to create an index which permits • 
anlaysis and conclusions. As often as not, 

USOE publications present raw data which are 
of little use to policymakers. 

One of the more discouraging findings of this study is that many 

of the problems that we have identified and the recommendations that 

we are making have, been noted by nitrous individuals and study 

« 

cosmittees over the past 30 to AO years. Those problems continue to 
exist. In light of the increasing operational role of the Federal 
government in education and the current crescendo of voices calling 
for a vast increase in the Federal share of total revenues for 
education in the 1970 's, the need for solutions to data prbblems 
has become critical. 

The primary reason why significant information gaps continue to 
exist while substantial recommendations have largely been ignored is 
that both the executive branch of the government — beginning with the 
USOE — and the majority of Federal legislators have in the past 
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not considered . the need for good Information about, education 

pressing to Insist that changes be made> Specifically, 
executives and legislators have failed to exert the aggressive 
leadership required to overcome bureaucratic lethargy and shortsighted- 
ness, and to provide the substantial Increase In funds necessarv 

■ s 

to get the same kind of job done In education that Is routinely 
expected of business and labor, agriculture, health, and a host 
of other Federal statistical programs. Without such leadership 
from the White House, the Secretary of Health, Education and. Welfare, 
the Commissioner of Education, key Senators and Congressmen, and without 
sufficient fiscal and staff recources, there Is little likelihood 
that our recommendations will fare any better than those of earlier 
studies. Put another way, the notion that the USOE should do a thorough 
and systematic job of analyzing and reporting the condition and 
progress of American education Is not just an Idea whose time has come. 
After more than 100 years of an Office of Education, It la, we 
believe, long overdue. 

Our recommendations have two foci. First, we discuss a series 
of recommendations addressed to the Information system for education as 

a whole, recommendations designed to generate and Institutionalize 

/* 

fundamental change In the process of collecting, analyzing sind 
disseminating Information. Second, we present recommendations dealing 
with each of the components of the system by focusing on the collection, 
analysis, and reporting functions Independently. 
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We must our recognition that these recommendations are not 

made to or about a static information system. Rather, the present 
activities of the USOE, including the publicly expressed intentions 
of the Commissioner, indicate considerably more drive towards develop- 
ment of a dynamic information program than at perhaps any previous time 
in the history of the Office.^ Some of the problems we have discussed 
have also been Identified by responsible officials within the Office. 
Similarly, some of our recommendations ane under internal consider- 
ation. . Nevertheless, there are areas in which substantial differences 
exist between our recommendation and present USOE plans. These 
result from our overriding concern with the needs of the policy 
process and our primary emphasis on serving the information require- 
ments of policy-makers In the executive and legislative branches 
of the Federal government, as well as citizens who must pass judgment 
on their actions. 

Recommendations 

We believe the following three recommendations are the moat 
critical that emerge from our research: 

1. Data Analysis 



of publications which explain spflitlal trends in (1) the demand for 
education, (2) its costs, (3) conceptions of equity in regard to 



^See "Data Gathering — a Time for Planning", a speech by 
Commissioner of Education Sidney P. Marland, Jr. presented to the 
opening session at the anruni Commissioner’s Conference of the 
Council of Chief State School Officers in Washington, D. C., 
Thursday, June 17, 1971. 



Para about American education must be analyzed . A series 
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educational services and costs, and (4) the Impact, both fiscal 
and, tcj the extent possible, educational of Federal programs should 
be produced by an analytical staff located In the National Center for 
Educational Statistics of the United States Office of Education. The 
function of the staff would parallel the activities of such agencies 
as the Bureau of Labor Statistics and the Office of Business Economics. 
More specific recommendations will be discussed below under analysis. 

2. Advisory Committee . 

To Rulde improvement in NCES information gathering, analysis 
and dissemination, an advisory committee should be created. Composed 
of recognized scholars and other pollcy~orlented users of educational 
data, the committee should be charged with producing an annual 
report to the Congress, Secretary of Health, Education and Welfare 
and to the Commissioner of Education on (1) the Important trends In 
the. condition and progress of American education and (2) the state 
of the Office's information collection, analysis, and dissemination. 

Such a committee, with a staff of Its own, would parallel in a general 
way the functions provided by such committees as the Advisory 
Conmlssion on the Education of Disadvantaged Children. Specifically, 
it would provide the immensely useful function in regard to data 
services of asking the essential question: "Information for what?” 

Ambitious organizational changes like those envisioned in the 
Common Core of Data for the Seventies will serve a useful function only 
as a body of analytically and policy-ori.ented people influence the 
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selection of items to be collected and the manner in which they are 
organized and presented. • 

3. In-depth analysis 

Ultimately, however, Independent, continuing, in-depth 
analysis of the state of American education and educational finance 
will come only from a body roughly comparable to the National Bureau 
of Economic Research. Funded, perhaps, by the National Institute 
of Education and the States, such a body could develop the prestige 
and competence to attract distinguished senior scholars and the most . 
able junior colleagues. Drawing upon the data of NCES, private Interest 
groups, and university based research; cutting across jurisdictional 
levels both horizontally among the agencies of the National Government 
and vertically among State Education Agencies and LocaI Education 
Agencies, such an agency Is the primary hope we have for the development 
of the all important capacity to provide critical analysis and evalua- 
tions of the Information collected about the condition and progress 
of American education. 

Additional Reconmendatlons 

I 

Having considered ways in which the Federal government can 
provide a framework and mechanism for reassessing information needs for 
policy formulation, we turn now to- recoMiendatlons that focus on the 
procedures for fulfilling those needs. The following three sets of 
recommendations are designed to improve the collection, analysis and 
dissemination functions of the DSOE. Specific attention is given to 
relationships between USOE and other agencies of the Federal government 
as well as between USOE and state and local education agencies. 
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A. Data Collection 

XVie thoroughness and effectiveness with which dnta are collected 
are two of the most critical elements In the process of developing a com- 
pfehenslve Information system* In recent years NCES has generally 
demonstrated the ability to effectively manage the data collection process 
for those areas In which It has responsibility. But as we have noted 
on several occasions in this Report, additional data pertinent to educa- 
tional policy are collected by program management bureaus of USOE and 
not currently controlable by NCES and by agencies of the Federal government 
other than the Office. One of the needs, therefore, is to bring data 
collected by other agencies to the NCES in a format that permits analysis 
with general purpose education data. Similarly, data collection procedures 
directed at state and local school districts can be improved in order to 
enhance the reliability of data and to reduce the burden; upon those 
agencies. The recommendations in this section focus on USOE activities, 
relationships %rlth other Federal agencies and relationships with states 

and local school districts. 

4.1. Office of Education Activities; 

These lecomnendations are addressed to the Integration of 
general purpose data and program m s n s geswn t data, shifting o^ the res 
ponslbility and reassessment of the Belmont Project, and d^elopmMt 
of a new "state specialist" approach to data collection. 

4,1,1, General purpose data— tlx)se data which are cur rently collcct^l 
by the NCES to Inform the nation about the "condition and progress of 
Am erican Education"— and data required for program management pur poses— those 
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data which are often required by legislation for monitoring Federal 
aid proBrama — should be Integrated. As we noted in Chapter IV, more 
than 90 percent of all data submitted to USOE by states and local 
school districts go to bureaus other than NCES. While such data arc 
undoubtedly important to the administration of programs, they may well 
serve as a rich source pf Information In addition to being an Immense 
burden on states. The story of the Title 1 Compliance Survey reported 
In Chapter IV Is probably only the most broad based and potentially 
useful of a number of similar situations. The point Is, ve have no 
Idea — and we suspect that neither do NCES staff nor top management at 
USOE — what program management data are collected and (1) the extent to 
which those data might be useful In providing answers to some of the 
Important policy questions and (2) the extent of the duplication that 
exists among the data activities of program bureaus. NCES staff are 
attempting to get a handle on this problem, but they clearly need the 
support of top level USOE management. The following four sub- 
reconnendatlons vlll help In that effort. 



a. NC3S should develop an Inventory of data requests, 
forms, reports. Individual data items, sampler, 
and USOE users. 

b. All surveys for data to states (and local districts) 
from USOE should be approved by NCES. 

c. Where necessary, legislation should be amended to 
facilitate v’ . o ordination and to reduce duplication In 
the Internal USOE data program. 




d. Appropriate staff positions should be allocated to 
NCES to accomplish tasks a and b. 

4.1.2. Consistent vlth 4.1. 1» the Belmont Project (Consolidated Pro- 
gram Information Report, Klenentary School Survey» Secondary School 

% 

Survey) which was designed to collect program evaluation Information 
should be assigned to NCES. NCES staff should conduct a thorough 
review of all components of Belmont to assess the extent to which the 
entire project can, with modifications, serve policy Information needs. 
Balmont was developed In the Bureau of Elementary and Secondary Edu- 
cation and then transfered to the Office of the Deputy Commissioner for 
Development. Recently there has been Indication that NCES would be 
assigned direct responsibility for Belmont. Such a move Is critical — It 
perhaps bears even more Important symbolic significance— to the centrali- 
zation and coordination of all USOE data activities, the Internal bureau- 
cratic politics of the Office notwithstanding. 

4.1.3. NCES should assign data collection specialists to a given 
number of states with responsibility for supervising the collection and 
Integration of data about those states from state education agencies 
and other Federal agencies. Such specialists would (1) become expert 
in the data problems of the states to which they are assigned, (2) 
serve as liaison persons with state education agency personnel and, (3) 
serve as liaison persons between NCES and USOE program management bureaus 
for their assigned states. Each specialist would be the most know- 
ledgeable person In the Federal government about any data that has bearing 
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on education in his assigned set of states. In this role )ie would be 
the person in NCES to whom state education agency data specialists could 
consistently turn and would be the resource person for other USOE 
personnel. The "specialists" designation implies positions that should 
have high stability over time with obvious implications for USOE personnel- 
policies. 

4.2. Interagency cooperation 



questions arising from any comprehensive education finance policy frame- 
work, including the one that we have proposed In Chapter V, is that much 
of the data come from sources other than USOE. Indeed, one of the major 
shortcomings in the NCES data program is that USOE publications rarely 
deal with education programs managed by or information collected by other 
agencies of the Federal government. Nhen USOE Is interested in obtaining 
data from other sources, NCES staff are largely dependent upon their 
ability to persuade their counterparts in other agencies of their needs 
for data relative to education Interests. Two steps are called for: 

4.3.1: Continuing support must come from the Commissioner of Education 

and, when necessary, from the Secretary of Health, Education and Welfare 
for strengt hailing the links between the various agencies collecting edu- 
cation data. The Office of Management and Budget can play and inq)ortant 
role in promoting such coordination among agencies. 

4.3.2: All Federal agencies that requ^est data from state and local 

education agencies should have requests approved and processed by the NCES 



, One of the realities of assimilating data in response to 
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forms clearance operation* Such agencies would Include: 



a. Office of Civil Rights, HEW 

b. Census of Governments 

c. School Lunch, Department of Agriculture 

% 

Just as the. laudable efforts of NCES to reduce the burden on states 
by avoiding duplication -of efforts and promoting effective coordination 
of surveys are often hampered by practices of other USOE bureaus, the same 
problems are created by agencies outside of the Office. The survey mailed 
to state education agencies by the Office of Civil Rights, HEW, in the 
early fall of 1971, is a recent example. That survey clearly ignored 
practices that had been agreed to by NCES and state representatives to 
the Committee on Educational Data Systaas. The states have every reason 
to expect better treatment from the Fedaral government. 

We fully 'recognise the pitfalls that exist in this recommendation 
which calls for greater bureaucratic centralisation, particularly when that 
centralization is placed in NCES, a relatively young organisation that has 
yet tc completely prove its coaipetence as a major statistical agency. There 
will undoubtedly be some short-term costs in efficiency from the stand- 
point of the other agencies. Nevertheless, those short-term costs should 
be off-set in the long run by reductions in the burdens placed on statei; 
and local school districts while at • the same tiM Improving the quality 
and usefullness of the data to policy-makers. 

A. 3 Role of the States 

NCES is largely dependent upon state education agencies for data 
about states and local school districts. Surveys typically go to state 
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data personnel even when they pertain to school districts or other sub- 
units. If the*, state education agency can supply Information from Its 
own records without sending the survey along to local districts, It 
usually does so. The following three recoisaendations deal ^th survey 

t 

flows, Integration of general purpose and program data at the state level ' 
cost of data collection. and compliance with Federal government requests. 

4.3.1: All surveys from agencies of the Federal government that re- 

quire elementary and secondary education data from states and local school 
districts should be sent to the state education agency. No surveys should 
go directly to local school districts. In short, the procedure thats 
generally observed in NCES should be applied to USOE program management 
bureaus and other agencies. 

4.3.2. : USOE procedures should be designed to encourage integration of 

general purpose and program data within |hc states . The same kinds of 
problems exist In this area at the state level Just as they do within the 
office. In fact, the problems may be worse. A recent study of the politics 
of Federal aid administration in six states noted that there were few 
efforts to coordinate and focus federally funded programs and that the need 
for such a focus was critical.^ One mechanism for encouraging coordination 
may be through data collection procedures. 

4.3.3. : All routine data requests from USOE should require state com- 
pliance . Failure to submit data should result in withholding of Federal 
aid to the state education agency. If the data are sufficiently important 
to the Federal government, compliance should be required. We recognize 



federal 



Aid to Education: Decision-Making and Allocation, 



Joel S. Berke, Michael Klrst, co-editorc, D.C. Health forthcoming May, 
1972. 



that this recommendation ia not conslatent with the views of approxi- 
mately tvo-chirds of the CEDS representatives whom we surveyed— they 
prefer a voluntary system with incentives— but it is the most realistic 
way in which to get data when it is needed. On. the other hand, such a 
requirement should place upon the Assistant Commissioner for Educational ^ 
Statistics and the Commissioner, of Education and the Advisory Coi^ttee 
that we have proposed' responsibility for assuring states .that data which 
are requested from the states are clearly needed In order to answer questions 
in the policy issue framework. 

4. A. 4: Tue cost of providing the Feder al government with informatio n 

beyond those normally undertaken by s tate education agencies and local 
achool districts should be assumed by USOE^ This is a principle that is 
easier to articulate than to operationalise. Procedures employed in the 
most recent Elementary and Secondary General Infon-tlon Survey C^EGIS) 
are a step in this direction. However, more extensive funding by the 
Federal government raises a number of thorny issues. For example, some 
states (Michigan and Hew York) already do a great deal more than other 
states in collecting data for their own purposes. Also, through state 
administration budgets for Federal aid programs soTse funds are already 
available for these purposes. The example of Hew York State 
in which the statewide testing program is funded through the 
Title I administrative budget was cited in Chapter III. There are numerous 
examples in other states that are more difficult to disentangle. 

5. Analysis of Educational Data 

This is the second functional area to which wc focus sj^cific 
reconmendatlcns. The n,o« critical «id broad baaad dealing with 
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the question of analysis of Information about education vcrc addressed 
in our first three recornmendatlons. The following three recommendations 
are designed to ItnpleTncnt those proposals. 

5.1: The USOE should have personnel on the staff oi NC ES trained 

in demonranhy. economics, education, public finance, socioloRy and oth ^ , 
areas of social science expertise in order to perform analy sis of data. 

Such analyses should focus on data regularly collected by the Office and 
be within the framework of the four broad issue areas discussed in 
Chapter VI. 

5,2: NCES should have an editorial staff assigned resp onsibility 

for insuring rcadabilit> and clarity of publications. Though an edi- 
torial staff cannot be thought of as a substantive addition to NCES, it 
may be the most practical way to make publications useful to policy 
makers who are not experts in education or statistics. 

5.3: NCES should have responsibility for analyzing only ongojj lgj. 

routinely collected data, including data collected as par t of prot;ram 
management activities within the Office. Longitudinal studies and in- 
depth analyses that occur only once or on an Irregular basis for exarnple, 
the Coleman Report — should be the responsibility of the staff of the 
National- Institute of Education or the Independent, government sponsored 
research organization proposed in recoanendatlon No. 3. Data collection 
for such studies should, of course, continue to be the responsibility of 
NCES . 

6 • DlssemliPitlon of Educatloral Inforrnatlon 

V?hat should be the format of a USOE publication series reporting 
on the condition and progress of American education? We recommend that 
there be three series of publications, each organized within the four 
issue areas of the policy framework. 
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6.1: The first series would be a computer listing includln^^; H&ble s 

of all data regularly collected about elementary and secondary education 



cations can be printed and disseminated almost inanedlately after the 
the last data items from a survey are submitted by states and placed on 
computer tapes and edited. If these survey reports are organized by 
states or region such as census of housing and census of population 
reports I the time span between publication and the period for which the 
data apply can be shortened even more. Clearly, such publications will 
Include no analysis, only raw data and computer generated analytical 
indices. 

6.2 The second series should be directed at readers who are laymen — 
policy-tnakers , citizens, etc. — and would include considerable analysis. 

The presentation would focus on clarity and would' emphasize charts, bar- 
graphs and other descriptive techniques that assist the reader in vitually 
Interpreting data. The focus of this scries would be on the policy 
questions and the analyses would clearly draw upon non-USOE data in 
addition to NCES surveys when the use of such data are appropriate to 
dealing with the policy issues. 

A significant component of this series should be early reports, 
possibly in a newsletter format, of the analyses of a single, concise 
set of issuer for which data are available} or trends are clearly dis- 
cemable. The current monthly report of the Assistant Commissioner for 
Education Statistical is a commendable step in this direction. 



from state education agencies and local school districts. These publi 




6.3: The third series of publications should be focused on the 

In-depth analysis that would be the charge of the fea earch orRanlzatlon 
proposed in RecommBndation No, 3» Such reports would appear as short 
monographs dealing with specific sub-lasues within the policy fraT?ieworfc 
Like the publications in series 6.2, they would be directed at laymen, 
though the substance of the analyses should reflect an exceedingly 
high order of scholarly research. 



f 

Summary of General Recommendations 

1. Data about American education must be analyzed. 

2. To guide Improvement in NCES information gathering, analysis 
and dissemination, an advisory committee should be created. 

3. Create or fund a research organization rou^ly comparable 
to the National Bureau of Economic Research to conduct 
independent, in— depth analysis of the state of American 
education and educational finance. 
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Summary of Additional Recommendacions 



4. Data Collection 

4.1 Office of Education Activities 

4.1.1. General purpose data and data required for program 
management functions, should be Integrated 

a. NCES should develop an Inventory of data 
requests, forms, reports, individual Items, 
samples and OE users 

b. All requests for data to states Csnd local 
districts) from OE should pass through NCES Forms 
Clearance Bureau 

c. Where necessary, legislation should be amended 
to facilitate coordination and to reduce 
duplication in the Internal OE data program. 

d. Appropriate staff should be assigned to accomplish 
tasks a and b. . 

4.1.2. Consistent V7ith 4.1.1. the Belmont Project should 
be assigned to NCES. NCES staff should conduct a 
thorough review of all components of Belmont. 
Particular attention should be given to the extent 
to which Belmont serves policy information neefi’*:?. 

4.1„3. NCES should assign data collection specialists to 
a given number of states. Such, specialists would 
(1) become expert in the data problems of the states 
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to which they are <lsslgned, (2) serve as 

a liaison person with SEA personnel and, (3) serve 

. I 

as a liaison between NCES and USOE program manage- 
ment bureaus for their assigned states. 

4.2 General Fonis Clearance 

4.2.1. All Federal agencies that request data from SEA's 
or local districts should have requests approved 
and processed by NCES Forms Clearance Bureau. This 
would include: 

Office of Civil Rights , HEW 
Census of Governments 

School Lunch, Department of Agriculture 



4.3 



Role of States 

4.3.1. All Federal government data requests should go 

from NCES to SEA’s. No requests should go directly 
to districts or schools. 

4-3.2. Every effort should be made to integrate general p 
purpose and program data within states. 

4.3.3. All routine data requests from NCES should require 
state compliance. Failure to submit data should 
result in withholding of Federal aid to SEA for 
all administrative functions. 



Analysis of Educational Data 

5.1 The Office should have personnel on the staff of NCES 
trained in demography, economics, education, public 



130 

- 123 - 



finance, sociology snc' other areas of social science 
expertise in order to peT.'form analysis of data. Such 
analyses should focus on data regularly collected and be 
within the framework of the four broad issue areas 
discussed above. 

5.2 NCES should also have an editorial staff assigned 
responsibility for insuring readability and clarity of 
publications. 

5.3 NCES should be responsible for analyzing only ongoing, 
routinely collected data, including data collected as part 
of program management activities within the Office, Longi- 
tudinal studies and in-depth studies that occur only once — 
for example, the Coleman Report -- should be analyzed by 
staff of the National Institute of Education or the 
independent, government sponsored research organization 
proposed in recommendation No. 3. Data collection for such 
studies should, of course, continue to be conductec! by NCES. 

Dissemination of Educational Information 

6.1, Publication Series: Three publication series should be 

produced relevant to the condition and progress of dimer lean 
education, each organized within the framework of the four 
issue areas. 

6.1.1. The first series would be computer listing and tables 
of all regularly collected data placed on computer 
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tapes. These publications can be printed and dias 

disseminated almost Immediately after last data items 
iiro submitted by states and placed on tape. If 
pub! > ' U inn.’, are produced by region or state, that 
is, anything smaller than the nation as a whole, the 
time span between publication and period for which 
data applies can be shortened even more. Clearly, 
such publications will include no analysis, only 
raw data and tables with computer generated analytical 
indices . 

The second series would be directed at readers who 
are laymen — policymakers, citizens, etc,. — and 
would include considerable analysis „ The presentation 
would focus on clarity and would emphasize charts, 
bar-graphs, and other descriptive techniques. 

Tlio, third series would be produced by the NIE or 
the research organization proposed in 4.3 above 
and would also be focused at laymen. Such reports 
would appear as short monographs that reflect in- 
depth analysis of specific sub-issues within the 
issue framework. 
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Analysis of the "Opinion Survey of fie Representatives to the 
Committee on Educational Data Systems Concerning 
Educational Data Collection" 

P urpose of the Survey 

A questionnaire designed to poll current attitudes and opinions 
on various aspects of collection and use of educational, data vas sent 
in mid-Oct oter , 1971 > to a select group of people engaged in educa- 
tional data collection at the state leveli^ This group comprises the 
55 representatives to the Committee on Educational Data Systems (CEDS), 
a standing committee established hy the Council of Chief State School 
Officers in 1962.^ The following analysis is based on the responses to 
specific questions, comments, and suggestions recorded on the question- 
naires returned to us hy CEDS members. A totEil of 37 quest ionnai. res 
were returned, 3 ^ of which were useable in the tabulation and analysis. 

All of the 3 ^ CEDS representatives are staff members of their 
respective Departments of Education who typically hold positions of 
director or compeirable status. As indicated in the table on the follow- 
ing page, ninety-two percent are engaged primarily in one or more aspects 
of design, coordination, and maintenance of information systems; research 
and development; evaluation; dissemination of educational data; and/or 
legislative laison activities. The remaining eight percent are connected 
more closely with school finance and accounting. The representatives are 

^CEDS members are changed with the responsibility of serving as a 
point of contact between their respective states and the nationEtl- level 
of educationaJL data collection and information dissemination. The U.S. 
Office of Education has an official relationship with the Committee 
through the Office of the Assistant Commissioner for Educational Statis- 
tics, who is eilso the director of NCES. USOE sponsors the quarterly 
meetings held in Washington, D.C., of the none-membsr CEDS Planning 
Committee which carries out the groups major liason work as regards the 
national collection of educatio-nal d rom the states. 




O 



"tlie condittec i 



.venly distributed in ters. of the nutdser of ye«« .e,tvlng on 

to three - 32 percent ; four to six years - 35 percent, 
less than one year to tnree Di> 

and, seven to nine years - 32 percent. yi«.een of the 34 have been, or are 
presentiy, officers in regional subgroups, on the CEDS Planning Co-ittee. 
and/or appointees to various USOE advisory cosmttees. With 34 of the 

atates represented there are no large gaps in regions or between sore 

1 

and less populous statesi. 



IVo Theniea 

. CEDS members sounded two theses throu^out their responses to 
specific questions as well as in open-ended consents, two the.es which 

n+cc the research and interviews on which other parts 
confirm in many aspects the researcn an 

of this study are based. The two themes focuB on: 

P. tv. atate l evel should provi_de_data^iS.n^^ 

agen cleB? 

Answer from CEDS representatives! SEA's onl ^. 

2. Wnw can we deal effectivel y with unwieldy eduoation al 

d ata systeii^J? 

^.swert o- r.- the National Centei^ o^u^ ational .Statisti^ 
(SCES) the n eeessarj: _ authority H «|, ano' 

Lor-dination of Offica °i M^cation, HEW ana otne _g j 

requests > 

Information flows: LEA -^SEA-> USOE 

oms members wanerolly agree that data should be collected by 



1 * 1 T BGCOtid week of Octotei*» ^ 

..... s«;s;.::rr. s:r ■“ 

contacted by mail only. 
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Table A-I 

Characteristics of Respondents 



Length of time CEDS representative 
less than 1 - 3 years 
4-6 years 
7-9 years 

Past/current meiriber of CEDS regional 
grouping. Planning Conaaittee , 
Advisory Committees 

Major professional urea due to more 

operational aspects of data systems 
School finance, accounting, etc. 



Regional representative 
Mid-Atlantic 
Southeast \ 

\ 

\ 

Midwest \ 

\ 

Southveet & Rocky Mt. \ 
Far West, Alaska and Hawaii 
Territories 



321 ^ 

33 % 

32 % 

44 ^ 



92 % 

Q% 



Percent region li 
of fifty states 



29 % I 
13 % [ 

27 % [ 

13 % [ 
13 % [ 
1 % 



22 % 

2k 

2k 

18 

12 



*A complete listing of respondents can be found at the end of this 



appendix. 
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national agencies from ths state educational agencies as a matter of 
course and not from LEA's or schools as indicated in these typical 
remaorks : ■ 



I believe that there is too great a tendency to want to by- 
pass state agencies and go directly to the local school for 
information. Requests arriving at the local school directly 
from V^ashington tend to undermine and defeat state efforts 
to establish and maintain .a comprehensive data gathering 
system. 

Another member comments on information systems within the 



states,: 

These systems must be mesuiingful and ussful at the local 
agency level so that it [information] can be collected 
and processed hy the state and fed to the national level 
as required. A master plan, financial aid, and initiative 
are lacking at this time. 

This general attitude is bssed on the idea that a smoothly opera- 
ting national data system would be enhanced by regularizing the channels 
through which information flows. As another respondent succintly states: 
•'The chain of data collection must be from LEA to State to USOE." 



Greater Coordination at the national Level 

The theme sounded mo?t often was that of the need for 
coordination and the authority to act as a central clearing house on 
the part of USOE. The comments of CEDS members range from a flat "decide 
what we need to know" to the expression of hope for continuing improve- 
ments , : 

I think NCES is improving. If they had more authority 
over what data is collected form [by] other branches , 
this would improve the data collection process. 

The two themes are linked together by the overarchi.ng concern for 

narrowing down the number of collection points of data, e.g. to SEA’s at 

the level of state to national channeling of information and to NCES 
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within the federal group of eigencies who collect educational data. 

Problei r o for -producers of da ta 

The genesiG of a number of problems noted "by CEDS representa- 
tives as producers of data is found, in part, in the proliferaiton of 
national agencies which find reason to request educational and. educa- 
tion-related data from states. The burden in terms of cost and tin» 
created by duplication of items on a number of data instruments Is the 
most obvious problem in this connection. Other problems such as a5?— 
sence of sufficient explanation of the need for the data and of suf- 
ficient lead time (civil rights Information mentioned most often) to 
provide the information are compounded by the appearance of a number of 
data requesting agencies on the national scene without effective control 
at some central point. Suggestions range from "establish effective 
scanning of all data instruments" to "allow only NCES to collect data.^nd 
have all other federal agencies and bureaus collect data only from or 
throu^ NCES." 

Problems for users 

As users of nationally reported educational data the repreaentatlveB 
emphasise most strongly the time lapse between collection of data and 
publication. One respondent co mm ented that one role of the national In- 
formation system should be to act as a trouble shooter , l.e. In the sense 
that potential problem-producing areas could be detected early be observing 
trends at the macro level, and warning signals sent out. For this 



^SEA and/or local education agencies receive requests for Informa- 
tion from NCES, HEW, Department of Agriculture , Census of Governments , 
and NEA. 
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kind of system to operate at all data publication would have to be very 
up-to-date. V/liile this "Early Bird Warning System" is singular Jn sug- 
gestion, the phenomenon of speedy relegation of information to archive 
status contributes greatly to the vulnerability of data collection agencies. 
Data must be "hot" or remain ignored. 

For purposes of policy formulation within their own states CEDS 
representatives express in a veiriety of ways the preference to use their 
own data rather than nationally reported data. This preference stems 
from a number of problems ranging from lack of comparability to skepticism 
concerning the accuracy of nationally published data. Ihere is no one 
over-riding problem which emerges. Rather, there may be a circular 
causation in motion that goes like this: the demand for interstate 

comparability data is still relatively low; when a state does need to make 
comparisons, national data is often in irreconcilable categories, different 
definitions, and contain inaccuracies. Tlie states, therefore, continue 
to shy away from greater use of national data. In other words , from the 
evidence presented by the results of this questionnaire, the comparability 
problem appears to be complex and self-fulfilling. 



Suggestions for improvement 

The two above mentioned themes carry through in the kinds of 
suggestions offered by respondents to improve educational data systems. 
Not too surprisingly, there is a strong bias in favor of maintaining 
the exi.sting system. Improvements in the direction of concentrating on 
NCES capabilities, federal funding of the additional costs imposed by 
producing data for national agencies, requesting data only from SEA's, 
and of imposing standards ore most common. Further investment in NCES 
and the setting of standards may be interpreted as affirmation of support 



for a coordinating center and clearing house from vhich guidelines (at 
the very mini.ir.um' to the whole- system emanate. The prefei'ence for the 
LK/V — SEA USOE flow of information is strongly reinforced. 
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The format for the presentation of detailed results from the survey 
follows. Questions are numbered as they were on the original questionnaire 
and are repeated with only sli gilt variation as appropriate. The summanry 
of the tabulation of responses iS’ given in precentages, ell of which 
are based on 34 except where otherwise indicated (with reason for the 
change of base). In some cases the replies to one question may not 
total 100 percent due to rounding, incomplete responses, and/or non- 
applicability of the question (a state not having school district' 
divisions). Upon perusal of the returned questionnaires questions with 
replies that lacked clear meaning were eliminated. A copy of the 
original questionnaire is attached. 
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Questlon-by-questlon results and analyala 



It is immediately apparent in the first four questions that confi- 
dence in making estimates from existing information rapidly diminishes 
as we look beyond the current budget year. In the first. coJ.umn we ste 
that 65 percent or more of the respondents z'eport that estimates of 
total state revenues, school district revenues, and the revenue raising; 
potentials of all local government imits contributing to educational 
programs can be made^ Slightly fewer, around three— fourths , report 
that infoination is sufficient to maice estimates in the current budget yeatr 
of the fiscal needs of state education programs. It shoxild be noted that 
the questions on revenue all pertain to existing tax sources and educa- 
tional programs. The confidence in m^ing estimates in the current 
budget year as well as the near future, even for existing revenue 
sources and programs, may reflect not only informationfa gaps, but also 
the prevailing uncertainties , surroimdlng state finances and allocation 
of persistently scarce resources. 

Tlie school districts in 88 percent of the cases do have good in- 
formation on existing levels of state and local sources of revenues, 
and in 68 percent of the cases on federal revenue sources. Availability 
of information on all sources of revenues at the school level applies only 
in a few cases. This pattern of information flows — more Information 
at the higher levels and diminishing as we move to smaller Jurisdictional 
units — may be consistent with the use of such information and the 
location of decision-making cc.;ters. 




Revenues 



In C7irrent 
b udget year 
" Yes No 
% % 



3. 



Does good information now exist for 
estimating your state's revenues for 
all governmental services from 
existing state tax sources? 

Does good information now exist on the 
current revenue raising potentials 
(capacities) of all of your state's 
local government units now contri- 
buting to educational programs in 
the state? 

Does good information now exist for 
estimating each school district's 
local revenue? 



U. Does good information now exist for 
estimating fiscal needs of existing 
state educational programs? 



85 



Thru next Over .next 
budget year five years 
Yes No Yes No 



% % 



% ■ % 



TH 21 21 62 



85 


6 


65 


2h 


18 


65 


88 


3 


56 


32 


18 


65 


77 


l8 


hi 


hk 


3 


82 



5. 



Is good information readily availa- 
ble concerning existing levels of 
revenuec from state and local. 



At school district 
level (LEA ) 

Yes No 






% 



At school 
level 
" Yes No 

% % 



b. 



sources? 


83 


12 


18 


7i* 


Is information readily available 
concerning existing levels of 
revenues from federal sources? 


68 


27 


15 


77 
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All "but one (97 percent) of the CEDS representatives say that good 
information is available on a regirlar basis to make possible the tracing 
of state categorical and federal funds to local school districts. Thirty- 
eight percent can trace these funds to the public school level and less 
than one-third can trace these monies to private and parochial schools. 
When we look at desirability for information we find that the one state 
that does not have the information for school districts would like to see 
his state have that information available. As meiny as three— fourths' of 
those states that do not have the data for the public school level would' 
like iiO see this situation remedied and 6is many as 80 percent of the 
states who do not have information on categorical and federal funds to 
parochial end private schools would like to have such data at their 
disposal. In other words, this is one area in which there is a demand 
for more complete information on the distribution of funds. Well over 
one-third of the members agree that methods of reporting should be 
changed. The kind of change is not specified, except to say that at least 
one-fourth of the representatives favor changing categorical grants to 
block grants. 




i . 



Di stribut ion of funds 



9. 



To pulilio school 
districts ( LEA ' s ) 



Putilic 

Schools 



Yes 

% 



No 

% 



Yes 

% 



No 

% 



To private 
ge parochial 
schools 
Yes . 

% 




7. Is good information routinely 
available vhich permits the state 
education department to brace the 
distribution of categorical state 
and federal funds? 

8. If any of your answers to question 



97 



7 are no 



do you believe that 



such information should be availa- 
ble? 

Note: percentages in this response 

are based on the number of no 
responses . in question 7» 



100 



38 56 



7U 



29 59 



80 



For financial 
auditing 

Yes No 

% % 



For program 
auditing 
Yes No 

% % 



Does good information now exist to 
insure that categorical state and 
federal funds distributed to school 
districts are used for purposed in- 
tended by the state? 



88 



12 



Change methods of 
reporting 
Yes 

% 



hr hr 

Change cecegorical io 



block grants 
Yes 

L- 



30. 



If such information is not readily 
available what steps would you 
recommend to be taken to insure 
that it becomes available? 



38 



27 
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Claasificatlon Criteria — Schools and LEA*f 

For purposes of classification of school districts it appears that 
information on handicapped pupils in vocational programs is collected by 
over 80 percent of reporting states. Just under two-thirds of the states 
have information on racial/ethnic characteristics, AFDG pupils, and type 
of community serviced. Under 20 percent have Information on • family Income 
of pupils. These figures reflect to some extent the history of items 
.included in educational data collection (chapter IV) . Interest in col- 
lecting information on vocational and handicapped programs was aroused much 
earlier and in this sense it might be expected that more states would have 
this information available on a systematic basis today . AFDC and 
racial/ethnic data are attached, on the one hand, to a particular program 
and, on the other hand, to a more recent awakening to concerns for pro- 
blems to which these data might apply. 

One respondent remoriced on the sensitivity of people to family in- 
come data and suggested that he found it more prudent to use estimates for 
the entire community. Similarly, there were more than a few remarks from 
CEDS representatives that raclol/athnlc Information was troublesons to 
collect due to sensitivities aroused In local conamnlties. Also, there 
was question whether state constitutions were being violated in this 
respect. However, since racial/ethnic data are required under the Federal 
Civil Rights Act, failuri to have date available cannot be dismissed on 
grounds of reluctance. 

Generally Information oa characteristics for school-by-achool 
classification is available in fewer states. However, vocational, handi- 
capped, and racieil /ethnic chai’acteristics are also of high relative 
availability at this level. 

148 - 



In columns two and four we see once again that there is a demand. 



althou^ not evenly distributed, for information on these characteristics 
on the school and school district levels in those states which report a 
lack of such data. It is hazardous to generalize this demend for data 
to include demands for more information from higher levels in the 



educational data system (i.e. national level). As the response to this 
particular question is m/4shed with the overall type of response to the 
questionnaire, it seems reasonable to sasert that states recof^nize gaps 
in their ovn information systems and favor expending their energies in 
filling those gaps. At this point, one respondent summed up a 
widely held opinion that states should be encouraged and supported to 



improve and stabilize their own information systems and that such 
improveittsnts would have a beneficial spillover effect for a national 
educational data system. 
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School districts 



Schools 



i 



Yes 



f . 



% of remainder 
who think infor*- 
mation should he 
Avail ab]^ 



Yes % 

% Of remainder 
who think in- 
formation 
should be 
avail le 



11. Does good information 
now exist in your state 
which permits classifi- 
cation of schools and 
lea's in terms of the 
following characteristics? 

12. If such data are not 
currently available 
which items do you 
believe should be 
collected? 



11 


& 12.1 


Racial/ethnic characteristics 


65 


IT 


53 


19 


11 


& 12.2 


AFDC pupils 


62 . 


15 


18 


18 


11 


& 12. 3 


Handicapped pupils 


82 


6t 


kk 


11 


11 


& 12.U 


Family income of pupils 


18 


32 


12 


IT 


11 


& 12.5 


Pupils in vocational programs 


85 


40 


T1 


20 


11 


& 12.6 


Type of community serviced 


65 


33 


27 


28 






(urban conmercial, urban 











Educational Need 

When asking about the availability of information on specific educa- 
. tional requirements aggregated up to the state level , we find that ap- 
proximately two-thirds of the states have necessary data in three areas of 
need: elementary school teachers, academic subject teachers, and teachers 

of the; handicapped. Closer to 50 percent have the information necessary 
for reading specialists and facilities. More importantly, except for the 
first category of requirements for elementary teachers where the number of 



O 
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states remain the same,, a greater number of CEDS representatives think 
this kind of information should be available on school districts. This is 
yet another indication of the recognition that gaps in information avail- 
ability still must be remedied at the state level for improved educational 
planning. 







Yes 


No 






% 


It 


13. 


Is good information routinely available? 
for estimating statewide requirements? For: 






13.1 


Elementary classroom teachers 


68 


29 


13.2 


Academic subject teachers 


65 


35 


13.3 


Handicapped teachers 


68 


29 


13.4 


Reading specialists 


56 


4l 


13.5 


Facilities 


47 


47 






Yes 


No 






% 


% 


14. 


Should such information be available 
on individual school districts? 






14.1 


Elementary and classroom teachers 


68 


15 


14.2 


Academic subject teachers 


71 


12 


14.3 


Handicapped teachers 


71 


12 


14.4 


Reading specialists 


65 


15 


14.5 


Facilities 


71 


9 
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Evalua tion and ac hieveiaan't inea $urcia ent 

In the opinion of many CEDS representatives evaluation of educa- 
tional programs has not reached a highly satisfactory level. If we look at 
the first column of question IJj which combines the "good" and "fair" 
categories , we see that only two types of programs are rated "by eis msiny as 
three-fourths of the responding states as having satisfactory evaluation 
techniques currently in use. The two programs— —handicapped and voca- 
tional — are consistent with the characteristics on which most states have 
data available for classification purposes. In some cases there axe 
definite reasons for low levels of program evaluation reported, e.g. the 
need for hi-lingual programs is limited to only a few states. This 
is revealed by the number (one-third) of states which responded that 
information is not availahle in this area. 

The amount of "good" quality program evaluation information on 
upgrading reading and ai'ithmetic skills is very low - l8 percent for 
reading and 15 for arithmetic. Furthermore, question l6 indicates that 
achievement information is not widely held at the state level since only 
one-third report having information at that level. Hor is it available 
in excess of 50 percent of the cases at other levels. According to the 
response to question 17, achievement reports are rarely used by states. 
Virtually none of the states use achievement information as a major com- 
ponent of general state aid, one state uses it for distribution of' 
federal aid, and only six states (l8 percent) use such data for 
distribution of categorical state aid for compensatory programs. 
Approximately one-third of the states reporting use achievement data to 
identify target schools and occassionally for general policy-making. 

A number of representatives remarked that achievement data 




are a 



much more localized item for collection and use. In other words, while 



achievement data may he an informationaO. input at the school level, they 
are not standardized for state collection, consumption, or comparison.^ 

A few states report programs just getting underway to institute statewide 
testing and collection of achievement data. This is another subject 
on which some CEDS representatives registered sensitivity to standeu'd- 
ization eind a hearty skepticism concerning the possible uses of such data. 



Total ■ Not 

Good & Fair Good Fair Poor Available 

% 1 — ? — r~ % 

I 






} 

I 







15 . How would you characterize 
the program evaluation 
information In your state 
concerning the following 
programs ? 



15.1 


Vocational education 


82 


kl 


35 


12 


0 


15.2 


Upgrading reading skills 


59 


18 


kl 


27 


12 


15.3 


Upgrading arithmetic skills 


53 


.15 


38 


29 


15 


15. u 


Other programs for the disad- 
vantaged 


71 


27 




21 


6 


15.5 


Pre-Kindergarten 


2k 


6 


18 


18 


53 


15.6 


Bi -lingual 


30 


9 


21 


29 


32 


15.7 


Handicapped 


76 


32 


kk 


12 


6 


15.8 


Enrichment 


27 


6 


21 


uu 


21 
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Yes 


No 






% 


% 


l6. 


Are reading and mathematics 
achievement information routinely 
available? 






l6.l 


The state as a vhole 


32 


65 


16.2 


School districts (LEA's) 


50 


1+1+ 


i6.3 


Elementary schools 


50 


1+1+ 


l6.U 


Hi^ Schools 


35 


56 


i6.5 


Special programs 


27 


59 






Yes 


No 






% 


% 


IT. 


How are achievement data used 
at the state level? 


• 




17.1 


As a major component 9 f the 
general aid formula 


- 


91 


17.2 


For the distribution of 
categorical state edd for 
compensatory programs 


18 


71 + 


17.3 


For the distribution of 
federal aid 


3 


85 


IT.l* 


For identification of target 
schools within school districts 


32 


62 


17.5 


In response to queries from 
legislators 


21 


65 


17.6 


Occasioneilly for general policy 
making 


35 


53 
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Relative usef\ilne33 of varloua natlc :a3 aources of educational a ata 

National reports on educationeil data are used at various levels 
of frequency. In no events however, do as many as 50 percent of the states 
report using any item mentioned "frequently". Federal aid data. (44 
j>ercent), state and local revenue data (4l percent), and salary level data 
(32 percent) are most used. In the center column we see that roughly 
one-third to one-half of .the states use the nationally reported data on an 
occasional basis. On the other hand, over one-third of the respondents are 
of the opinion that data on enrollment projections, staff characteristics, 
and achievement are not used and one-half report the same for pupil 
character! sites data. 

On the whole, the response to questions on actual use of nationally 
reported data at the state level indicates only moderate exploitation of 
this information resource. Nevertheless, those who think the same kinds of 
data should not be collected from SEA's are very few (column one, 
question 24) . Ihe remarks in this respect generally indicate that states 
prefer to use their own data which arc mere reliebie and consistent with 
their data needs and only occasionally find reason to go to national soui'ces 
This idea prompted at least one respondent to remark that the national 
sigencles should decide what is needed for national pxuposes , whatever they 
are, and stop trying to fulfill everyone's data needs and demands at the 
same time. There is a basic inconsistency which begins to emerge dt this 
point. 

While the CEDS representatives do not give evidence of hi^ levels 
of utilization of nationally reported data, they do not object strongly to 
their providing this information to national agencies. This suggests that 
the producer/user roles may not be as closely linked eis is often 
assumed. The states may find a mi directional flow of information to the 




nA^lOBftX level fundesent&lly acceptable* In other vordtt can hypoth- 



use to individual states and national decision makers. This conclusion does 
not in any way suggest that states would provide limitless amounts of* in- 
formation or provide data indiscriminately. 

A nore vlgoroua response occurs regiirding the collection of data 
■bout individual schools. Consistently between one-third and one-half 
of the respondents are of the opinion that all data items mentioned 
should not be collected about schools. This response matches the many 
comments to the effect that CEDS representatives prefer that national 
agencies should not require data with a level of specificity appropriate 
for local school district decision medcing. 



eslaethat 1) there is a consensus that a need for educational data at the 
^^tional level does exist i and 2) the data need not necessarily be of ec^ual 







Not 



Used 



Used 



Used Occasionally Frequently 



O 

ERIC 



l8. National agencies and 

organizations collect data 
from state education agencies. 
In your opinion, to what 
extent are national reports 
of such data used at the 
state level? 



l8.1. Enrollment Projections 


18 


kk 


35 


l8.2' Pupil Characteristics 


6 . 


35 


. 50 


18.3 Staff Levels 


21 


1+7 


2 I+ 


18 . ^4 Staff Characteristics 


2k 


35 


35 


18.5 Salary Levels 


32 


53 


9 


18.6 Expenditures by function • 


29 


1+1+ 


21 


18.7 Expenditures by program 


12 


1+1 


29 


18.8 Achievement 


9 


35 


35 


18.9 Physical facilities 


6 


53 


2 I+ 


18.10 Federal aid 


kk 


1+1+ 


3 


16.11 State and Local Revenues 


ki 


1+1 


12 


2k. What data should not 

be collected nationally? 


SEA 

% 


LEA 

% 


School 

% 


2 U.I Enrollment Projections 


9 


29 


53 


2 U .2 Pupil Characteristics 


12 ^ 


27 


1+1+ 


2 U .3 Staff Levels 


6 


18 


1+1 


2 U.I 4 Staff Characteristics 


6 


18 


**1 . 


2 U .5 Salary Levels 


6 


18 


1+1 


2 U .6 Expendit\ires by function 


3 


15 


38 


2 V .7 Expenditures by program 


6 


18 


38 
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SEA 

IT 


LEA 

'T" 


School 

i 


2 U .8 


Achievement 


12 


24 


Ui 


2U.9 


P'^ysical facilities 


9 


15 


35 


2U.IO 


Federal aid 


9 


15 


35 


2U.ll 


State and Local revenues 


6 


15 


35 


The 


greatest problem affecting the 


level 


of vise of data 


is the 



span between the tine to which data applies and the date of publication. 
Sixty-five percent of the states report this as a frequent problem and a 
large number of representatives emphasized the problem in their comments. 
Results showing that over one-third of the representatives feel that 
national data duplicates the states' holdings and are of questionable 
accuracy confirm the eeirlier stated opinion that the states prefer to use 
their own data. The fact that 53 percent of the states say that "infor- 
mation not relevant to our data needs" is an occasional problem while 
another 21 percent say it is a frequent problem ties in with the same 
general opinion on use of data. 



Frequently Occaaionally Not a 
a ■qrobleir. a problem Prob lem 
1 % ' ^ 



19. Listed be 3 .ow are some common 
reasons why data collected by 
national agencies may not be 
3 useful to you at the state 

level. Check the appropriate 
column according to your 
experience. 



19.1 


Data collected are not published 


2 U 


38 


18 


19.2 


Data are published too long after 
the period to which they apply 


65 


21 


6 


19.3 


Level of aggregation is inappropriate 
(e.g. classroom, school, school dis- 
trict, etc. ) 


21 


Ul 


2 k 


19. u 


Redefining of categories renders 
published version useless 


21 


U 7 


12 


19.5 


Format is not appropriate 


15 


32 


29 


19.6 


Information is not relevant to our 
data needs 


21 


- 53 


9 


19.7 


National data duplicates what the 
state already has 


38 


2.7 


18 


19.8 


Data are of questionable accuracy 


35 ■ 


27 


15 


19.9 


Definition of items on data instru- 
ment not clear 


27 


38 


15 



In asking about the descriptive quality of nationally published 
educational data we found that approximately 80 percent are of the opinion 
that data are moderately accurate for individual states. Seventy 
percent agree to moderate accuracy for the country as a whole. The two 
most frequently mentioned problems are comparability and level of gen- 
p-t aH ty. The fact that over half of the respondents think that the format 
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used to enforce coaf)srsbillty of date is distorting is fortified in the 

reaiilta of question 19 . Approjdmately tvo-thirds report that the level 
of aggregation and redefining of categories are barriers to greater use 
of nationally reported data. Too high a level of generality is one by- 
product of the difficulties of making categories that permit compauability 
among fifty states. 

Bis problem of comparability of data has not been ignored at the 

1 

national level, as evidenced by the effort in the handbook series, for 
example. The question is very much open-ended, however, as to the extent 
to which states demand data to make inter-state comparisons. 

The tone of most remarks in the questionnaire places enqphetsis on 
the reality that states rely on their own data. Furthermore, at this 
point states have to give higher priority to internal demands to fill 
information gaps and solve the anomalies in their. own systems than they do 
to find ways in which to make comparisons possible with other states. 
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Very 



Accurate 



Moderately 

Accurate 




In accurate 

^IT' _ 



Do you feel that data collected 
and published nationally give 
an accurate description of the 
condition and progress in your 
state? 



79 12 



25. Does the kind of information 

currently being collected con- 
tribute to ein understanding 
of the condition and progress 
of education in the United 
States as a whole? 3 


68 9 




Yes 

Jl. 


22. What eire the reasons con- 

tributing to less-than-desired 
levels of accui”acy in describing 
the condition and progress of 
education in your state? 




22.1 Formats utilized to provide com- 
parability- with other states distort 
true description 


53 


22.2 Information requested is too specific 
for an accurate description 


18 


22.3 Information requested is too general 
for an accurate description 


4l 


22. U Information is too inaccurate 


15 


Possible problems of data collection 

Three queetlons taken together deserve close examination for 
purposes of pinpointing major sources of prohlems in general as well as 
specific factors that affect the quality of data received at the national 
level. In question 2T.1 belot ve see that dv, plication of data on a number. 



of data instruments is a major source of problems according to Just over 
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50 p*^rcent Gf the CEDS representatives and a minor source mentioned by 
another 27 percent. Duplication is an annoyance type problem that bears 
directly on the complaint of unreasonable burden in terms of cost- of data 
collection. The cost burden is reported as a major source of problems 
by sli^tly more than Uo percent of the respondents and a minor source by 
another one-third. Fortunately the duplication of whole surveys is not so 
* prevalent a source of problems. Approximately 25 percent of the rep- 

resentatives do mention it as a minor source due to the periodic "boot- 
legging” of surveys that go through without official permission ^ 

Requests for data not otherwise collected are recorded as a major . 
source of problems in collection in only 29 percent of the cases. 

However, it is a minor source of problems in more cases (UU percent) and 
in terms of the effects on quality of data it is perceived as a seriqus 
hindrance. Approximately TO percent of the representatives see it as 
a ranking problem for data reported to national agencies by SEA's and 
60 percent see it as a ranking problem for reporting from LEA's and 
schools. This is another problem that bears on cost of data collection 
as veil as quality. New items require more time to gather and 
the resxilting pressures on existing staff become greater. In foot, 
another ranking problem is size of staff available to fill all requests 
for data as we see in 30.3 and 31.3. The problem for "need for data not 
>' established" can be combined with that of "information does not lead to 

understanding of real issues" and "perceptions of who benefits." 

All of these problems can be seen os different facets of the larger 
problem of usefulness of data as perceived by the producer of the data. 
Approximately 40 percent of CEDS representatives see the lack of 
establishing need and the doubt as to whether particular information 
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enhances understandi.ng of issues as major sources of problems for data 
producers. At least one-third see perceptions of "who benefits" as a 
ranking problem that affects the' quality of data reported to national 

agencies. 

The problem of insufficient lead time allowed the states in pre- 
paring data and in completing data instruments is pervasive as it cones 
through in the remarks and suggestions for improvements of the national 
data collection system. One-half of the representatives record this 
as a major source of problems and another 25 percent as a minor source. 
Sixty-twp percent see the time factor as affecting quality of data from 
SEA'S and , approximately 50 percent as affecting quality from LEA's and 
schools. When asked in an open-ended question how the major sources of 
problems could be solved, as overwhelming majority of the respondents 
suggested that USOE, NCES, or some central bureau within the agency 
must take its coordinating ' and clearing house responsibilities more 
seriously. Other major suggestions specified the need to grant realistic 
lead time to producers of data, to eliminate time and cost consuming format 
changes so frequently, and to focus on collection of data from SEA's 



only and not other levels within the states. 




Ma.jor source Minor source Rarely source 
of* problems of p roblems of problems 

% % % 



27. 


Express the extent to which the 
reasons for probleins with data 
collection listed apply to your 
situation. 






• 


27.1 


Duplication of data items on 
various surveys from national 
agencies and organizations 


53 


27 


6 


27.2 


Duplication of whole surveys 


3 


2U 


29 


27.3 


Requests for data not other- 
wise collected, i.e. new item 


29 


UU 


6 


27.4 


Need for data not established 


Ul 


29 


12 


27.5 


Data instrument given to states 
without sufficient lead time 


50 


2U 


12 


27.6 


Cost of data collection burden- 
some 


UU 


35 


9 


27.7 


Information does not lead to 
understanding of real Issues 


38 


2U 


18 


27.8 


Definitions of categories vague 


15 


Ul 


18 


27.9 


Requests for data are untimely 


2U 


UU , 


12 



-157 " 

164 






ERIC 

! 



Ranked 


Ranked 


Ranked 


Total 


1st 


2nd 


3rd 




■ % 


T" 




'% 



30. What factors affect the 

quality of data reported to 
national agencies hy state 
agencies? 

30.1 Who pays for data collection 3 ' 12 

30.2 Perceptions , of who benefits 

from the data collected .12 9 

30.3 Size of staff available 
to meet all requrest from 

an sources of data ^^9 2U 

30.4 Level of staff expertise 1? 9 

30.5 The time alloted for 
collection of data, i.e. 

due datesi 21 



0 15 

12 33 



9 62 

6 27 

35 62 



30.6 Whether the state or 
its districts already 
collect the requested 
data 


21 


2T 


21 


69 


30. T Quality of data pro- 
vided by lea’s 
to state agency. 


18 


24 


9 


51 


31. What factors affect 
the quality of data 
reported to the 
national agencies from 
local education 
eigencies and schools? 


, f 








31.1 Who pays for data 
collection 


6 ' 


3 


0 


9 


31.2 Perceptions of who 
benefits from the 
data collected 


24 


9 


6 


39 








\ 



1 



' • 1 



> 






Ranked 


Ranked 


Ranked 


Total 


1st 


2nd 


3rd 




■ % 


P 


% 


% 



31.3 Size of staff 



availal)le to meet 
aJ.1 requests from 
all sources for 



\ 




data 


15 


21 


15 


51 




31.1+ 


Level os staff 
expertise 


15 


24 


6 


45 




31.5 


The time allotted 
for collection of 
data, i.e. due dates 


3 


18 


27 


48 




31.6 


Whether the requested 
data is routinely 
collected 


21 


15 


24 


6o 



Suggestions for improvement of educational data systems 

A set of general guidelines to set the parameters of an improved 
program for educational data systems is fairly widely agreed upon. 
Approximately 60 percent of the respondents agree that l) the national 
data collection system should continue to be voluntary, 2) data col- 
lection costs should be funded by the federal government to the extent 
that federal agencies increase the cost of collection by their requests 
to the states, and 3) the National Center for Educational Statistics 
of USOE should collect data from state educational agencies and have the 
responsibility of providing a national educational data base. 

Along v:ith partial funding of data collection by the federal 
government, 77 percent agree that there shoiild be imposition of some 
kind of standards, although these standards are not specified. 

It is interesting to note that almost one-third of the group 
think that the federal , data collection should be non-voluntary (similar 



to the U.S. Census) and of those eleven, who make up the third, 



six agree that data collection shoiild be totally ftinded by the federal 
government with standards imposed. In other words , 20 to 33 percent 
of the group can visualize more rigorous measures to insure system 
maintenance as a necessity for improvement. 

In connection with number 3 above, most of the 60 percent in- 
dicated specifically in this question that collection by the federal 
government should be from state educational agencies and not from any 
smaller local units within the states. About 60 percent also agree 
that there is not a need for a new bureau within HEW to coordinate or 
otherwise provide a national system. 

In the following set of q^uestions the various suggested methods for 
improvement are broken down into their major elements. Please check 
(x) the statements you believe to be feasible and desirable. 



Checked 

% 



32. Voluntary vs. non-voluntary approach. 

32.1 Continue with voluntary system similar to the 



one which now exists 62 

32.2 Federal data collection should be non- 
voluntary (similar to the U.SCensus) 32 

33. The costs of data collection should be funded. 

33.1 Totally by the federal governments 27 

33.2 partially (to cover the additional costs in- 
curred by meeting federal agencies’ requests 

for information) by the federal government 59 

33.3 by source other than the federal government 

(specil'y) 6 







Checked 

' '% 



3^. ■ The federal government should 

3^.1 fund data collection and in^jose standards 

3^.2 fund' data collection and not impose 
standards 

3^.3 not fvtnd data collection, but should 
In^ose standards 

3^.^+ not fund data collection and not attempt 
to impose standards 

35* The National Center for Educational Statistics' of 
U. S, Office of Education should be expaiided 
and strengthened with a capability to 

35 •! directly collect data in the field 
and provide a comprehensive natibnal 
educational data base 

35 • 2 collect data from state and local education 
agencies and provide a national educational 
data base 

35«3 collect directly, or from other agencies, 
and publish only the in^jortant in- 
formation for which a demand exists, 
but which cannot currently be supplied 
from any source in the necessary form 

35.^ disagree with idea that NCES should he 
involved with improvement scheme 

36. A new bureau under the Department of Health, 
Education and Welfare should be established 
to 

36.1 collect and bring together for publication 
data which relates education to the other 

areeis of socio-economic concerns 

r 

36.2 provi.de a national educational data system 

36.3 do not agree with suggestion for new agency 
under HEW 



TT 

15 

0 

3 



0 



62 



15 

6 



6 

12 

59 



RESPONDENTS TO CEPS QITSTIONNAIRE 



REGION 
Mid- Atlantic 



I 

I 



I 
! 

Southeast 



Mid-West 



ERIC 



RESPONDENTS NON-RESPONDENTS 



Connecticut ' New Hampshire 

Maine 

Massachusetts 
Rhode Island 
Vermont 
Deleware 
Maryland 
New Jersey 
New York 
PeMsylvunia 



Arkaneas 


Alabama 


Florida 


North Carolina 


Georgia 


South Carolina 


Kentucky 


West Virginia 


Mississippi 




Tennessee 




Virginia 




Indiana 


Illlnbls 


Michigan 


Missouri 


Ohio 


Nebraska 


Wisconsin 




Iowa 




Kansas 




Minnesota 
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ii 
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RESPONDENTS TO C£DS QUESTIOIWAIRE 
(continued) 



REGION 


RESPONDENTS 


NON-RESPONDENTS 


Mid-West 


North Dakota 






South Dakota 




Southwest & 


New Mexico 


Arizona 


Rocky Mts. 


Oklahoma 


Colorado 




Texas 


Montana . 




Idaho 


Utah 


Far West 


Wyoming 

California 


Washington 




Nevada 

Oregon 


• 


Territorial 


Alaska 

Hawaii 

Guam 


Virgin Island! 



Suioa 

Puerto Rico 




f 




I 
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TO: State Representatives to the Committee on Educational 

Data Systems 

FROM: Amos Kimberling, Chairman, CEDS Planning Committee 

DATE: September 29* 1971 

RE.: Study for the President's Commission on School Finance 



The Policy Institute of the Syracuse University Research Corporation 
in cooperation with the Maxwell Graduate School of Citizenship and Public 
Affairs of Syracuse University is cvirrently engaged in a study for 
]?reBldent'8 Commission on School Finance. The report, tentatively titled 
IMPROVING INFORMATION SYSTEMS FOR EDUCATIONAL POLICY MAKING, focuses on 
issues import ant to educational policy Tiiakers • 

Dr. Robert J. Goettel, project manager for the Policy Institute, 
has been in contact with me concerning the study for the past several 
weeks. In addition. Dr. Goettel discussed the study with the CEDS Planning 
Committee at the September meeting in Washington. As part of the study 
a survey is being made of CEDS representatives in order to answer the 
question: how can national data collection procedures be improved to better 

serve the information needs of states and local school districts as well 
as the federal government? The enclosed questionnaire represents one facet 

of that survey. 

I know that in your role as a CEDS representative many of you have 
strong opinions about the procedures employed in collecting and dissemi- 
nating data. Those opinions are critical to an understanding of the ways 
in which such procedures can be made more efficient and more useful to 
everyone concerned. For that reason, I urge you to complete the question- 
naire in such a way that you are satisfied that the Policy Institute and, 
in turn, the President's Commission are apprised of your opinions. 

You are encouraged to use the open-ended questions to make your 
thou^ts known.* Also, please comment on additional Issues not addressed 
in the questions which you believe must be considered in the study . If 
you have any questions concerning the svirvey, contact: Dr. Robert Goettel 

at (315) J*77-B662. 

On behalf of the Policy Institute and the President's ConuniBsion I 
want to thank you in advance for yoiir cooperation in this survey. 



Sincerely , 



/ 



/ 
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Policy Institute 





October 15 j 1971 



I 




Approximately two weeks ago you should have received an 
Opinion Sui*vey questionnaire with a cover memo from Amos Kimherling, 

Chairman of the CEDS Planning Committee. This questionnaire is one 
part of a study ve at the Policy Institute of the Syracuse University 
Research Corporation are conducting for the President's Commission , 

on School Finance. The study is tentatively titled ^'Improving ' 

Infonnation Systems for Educational Policy Malting. ” 

We are finding completed questionnaires thus far returned to 
UB extremely helpful in examining prohlems, issues, and viewpoints 
about Federal/State relations in an education information system. 

Since each CEDS repre^Tcntative is a critical link between his state 
and the Federal Government, it is essential that ve obtain as com- 
plete a picture as possible of your opinions. 

We urge you to participate in this survey for the President’s 
Commission by sending a completed questionnaire with your comments 
to us by Friday, October 22. If you have any questions or, perhaps, 
if you would like us to send you another copy of the questionnaire, [ 

please call me collect at (315) 477-8662. 

Please accept in advance our thanlcs for your cooperation. 

Sincerely, 



RJG/lun 



Dr. Robert J. Goettel 
Project Director 
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OPINION SURVEY 



of the Representatives to the 
Committee on Educational Data Systems 
concerning 

Educational Data Collection 

1 . Name : 

2. Title: 

3. Office address: 



U. Telejiione number: 

5. Brief description of your major responsibilities: 



6. How long have you been a CEDS representative? 



7. What offices do you hold as a representative to CEDST (in regional 
grouping, advisory committees to federal government, etc.) 



ADEQUACY OF EXISTING INFORMATION USED IN EDUCATIONAL POLICY MAKIUG 

Policy making in education typically requires aneilysis of in- 
formation concerning potential and existing levels of funding, 
estimation of educational needs, assessment of adequacy of funding to 
meet educational needs, and evaluation of outcomes of educational 
prcgraina being funded. In order to determine the perceived adequacy 
or inadequacy of such information, we are soliciting your op inions in 
the following questions.. Unless otherwise specified, all questions 
throughout refer to information availability , etc . , at the state 
level . 

REVEWUE8 

1. Does good information now exist for estimating your state's revenues 
for all governmental services from existing state tax sources? 



1.1 


- 


In current budget year 


Yes 


No 


1.2 


- 


Throu^ the next budget year 


Yes_ 


___No_ 


1.3 




Over the next 5 years 


Yes__ 


_No_ 



2. Does good information now exist on the current revenue raising 
potentials (capacities) of all of your state's local governmental 
now contributing to educational programs in the state? 



2.1 


- 


In current budget year 


Yes_ 


_No_ 


2.2 


- 


Throu^ the next budget year 


Yes_ 


__No. 


2.3 


— 


Over the next 5 years 


Yes__ 


__No. 



Does good information now exist for estimating each school dis- 
trict 'sTocal ravenua? 



3.1 


- 


In current budget year 


Yes__ 


No 


3.2 


- 


In the next budget year 




__Io 


3.3 


- 


Over the next five yeeirs 


Yes__ 


__No 


Does good information now exist for estim£iting fiscal 
existing state educational progrsma? 


needs 


Of 


4.1 


- 


In current budget year 


Yes__ 


__No 


4.2 


— 


In the next budget year 


Yes 


No 



h.3 



Over the next five years 
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Yes No 



5i Is good information readily available concerning existing levels of 
revenues from state and local sources? 

5*1 - At school district level (LEA) Yes _No 

5*2 - At school level Yes No 

6. Is information readily available concerning existing levels of 
revenues from federal sources? 

6.1 - At school district level (LEA) Yes N o 

6.2 - .At school level Yes _No 

DISTRltelOH OF FUNDS 

. 7 . Is Kood information routinely available which penoita the state 
education department to trace the distribution of categorical 
state emd federal funds? 

7 'll - To public school districts (LEA's) Yes No 

7*2 - To public schools Yes No 

7.3 - To private and parochial schools Yes _No 

8. If any of yoTxr answers to question 7 are "no", do you believe 
that such information should be available? 

8.1 

6.2 

8.3 

9 . Does good information now exist to insure that categorical state 
and federal funds distributed to school districts are used for 
purposes intended by the state? 

. 9.1 - For financial, auditing Yes _No 

9.2 - For program auditing Yes No_ 

10. If such information (question 7-9) is not readily available, what 

steps woTild you recommend be taken to insure that it becomes available? 

10*1 - Change methods of reporting on programs Yes No 

Coaaent^ 

10.2 - Change categorical grants to block grants Yes No 

Comment 

10.3 - Other (Specify) Yes No 

CoBBent 



On public school districts (IAEA's) Yes No 

On public schools Yes N o 

On private and parochial schools Yes ^No 
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CLASS lyiCAT ION CRITERIA - SCHOOLS 4 LEA *8 

11. Does good Information now, exist In your state which permits classi- 
fication of schools and LEA's? In terms of: 

School Not 

Districts Schools Available 

11.1 EacieLl/ethnic character- 
istics 

11.2 AFDC pupils • ^ 

11.3 Heuidicapped pupils ______ ' 

11. 4 Family income of pxqpilf ■ i; ■ 

11.5 Pupils in vocational 

programs 

11.6 Type of community ser- 
viced (urban commerciel, 
urban residential, suburban^ 
commercial, non-faz*ming 

rural, etc.) ■ 

11.7 Other 



12. If such data are not currently available, which items do you 
believe should be collected? 

School 

Districts Schools 

12.1 Eacial/ethnic character- 
istics 

12.2 AFDC pupils 

12.3 Handicapped pupils 

12.1* Family income of pupils 

12.5 Pupils in vocational 

programs 

12.6 Type of community ser- 
viced (urban commercial, 
urban residential, suburban 
commercial , non-farming 
rural, etc.) 

12.7 Other 

COMMEirrS 
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EDUCATIONAL NEED 



13. 


Is fipod information routinely available for estimating statewide 
requirements? For : 




13.1 


Elementary classroom teachers 


Yes_ 


No 




13.2 


" Acitdexnic subject teachers 


Yes 


No 




13.3 


- Handicapped teachers 


Yes_ 


No 




13. u 


- . Heading specialists 


Yes^ 


No 




13.5 


- Facilities 


Yes_ 


No 


IJ*. 


Should 


■uch inforaatlon he available on Individual 


school 


districts? 




lU.l 


Elementary classroom teachers 


Yes_ 


No 




1U.2 


- Academic subject teachers 


Yes_ 


_No 




1U.3 


- Handicapped teachers 


Yes_ 


No ‘ 




ih.U 


- Reading specialists 


Yes_ 


No 




1U.5 


Facilities 


Yes_ 


_No 



EVAMJATIOW AMD ACHIEVEMPIT MEASUREMENT 



13. Hov would you characterize the program eveJ.uation 
in your state concerning the following programs? 

Good Fair 


information 

Not 

Poor Available 


15.1 


Vocational education 


♦ 


15.2 


Upgrading reading skills 




15.3 


Upgrading ari.thmetic skills 




15. U 


Other progri'jss for disad- 
vantaged 




15.5 


Ihre-Kindergarten 




15.6 


Bl-lingual 




15 . 7 


Handicapped 




15.8 


Enrichment 





I 



I 



I 



% 










;V 
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l 6 . Are reading and mathematical achievement Information routinely 
available? For: 



16.1 


The state as a \diole 


Yes No 


16.2 


School districts (LEA'b) 


Yes No 


16.3 


Elementary schools 


Yes No 


16. 1* 


Hi^ schools 


Yea No 


16.5 


Special prograne 


J 

1 

m 



17 • Hov are achieveaent data \ieed at the state level? 



17.1 


As a major component of the general aid 
formula 


Yes_ 


_No, 


17.2 


For the distribution of categorical state 
aid for compensatory prograns 


Yes_ 


_Jlo 


17.3 


For the distribution of federal aid 


Yes__ 


_No. 


.17.4 


For identification of target schools 
vlthln school districts 




_Jfo. 


17.5 


In resjwnse to qxieries from legislators 


Yes_ 


_No_ 


17.6 


Occasionally for general policy making 


Yes_ 


_No. 



If you have additioDal coaMnts on Adequacy of Exlating Infoxvatlon, 

please sake them here : 







RELATIVE USEFULMESS OF VARIOUS NATIONAL SOURCES OF E DUCATIONAL DATA 

Much of the data that coviid he dravn upon evaluating current 
policies and in designing new programs is scattered among a variety 
of national agencies and organizations. This has led to an org^ za- 
tion of national data that has hecome extremely difficult 
together for policy formulation. On the other hand much of this ^ -a 
is (or possibly could be) extremely useful in policy making at all 
levels of educational administration. 



l8. National agencies and organizations collect data from state educa- 
tion agencies, local educational agencies and schools. In yow 
opinion, to vhat extent are national reports of such data uaad 
at the levels indicated? 



Enter numbers as appropriate: 0 don't know; no opinion 

1 not used 

2 used occasionally 

3 used frequently 



KjraB OF DATA REPORTED 
■ATIONALLT 


LEVELS 
Btate LEA 


School 


COMMENTS 


l6.1 


EnrollJBtnt Projections 










10. 2~ 


Pupil Characteristics 










10.3 


Staff Levels 










10 . V ” 


Staff Characteristics 










10.5 


Salary levels 










10.6 


Expenditures by function 










• 

GO 

Ir-I 


Expenditures by program 










10.8 


Achievement 










10.9 


Physical 

Vacllities 










10.10 Federal 
Aid 


• 








1^.11 


state and Local 

Revenues . 










10.12 


Other 
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19. Listed below are sooe coBaK>n reasons vhy data collected by national 
eigencies nay not be yseful to you at the state level. Check tbe 
appropriate column according to your experience . 

Freqtuently Occasionally Not a 
a Problem a Problem Problem 

19.1 Data collected are not 

published 

19.2 Data are published too long 
alter the period to vhich they 

apply 

.19.3 Level of aggregation is inap- 
propriate (e.g. classroom, 

school, school district, etc.) 

19. ^ Redefining of categories 

renders published version 

useless -- 

19.5 Format is not appropriate ______ 

19.6 Information is not relevant 

to our data needs _______ ■ — 

19.7 Hatlonal data duplicates what 

the state already haa _______ - - — 

19.8 Data are of questionable 

accuracy ■ ■ - 

19.9 Definition of items on data 

instrument not clear — -- 

19.10 Other (Specify): — 

20. Give a brief statensnt, or exai^es, of kinds of national data 
that are« not used to any appreciable extent at the state level and 
the primary reason (a) why this is the case. 
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21. Do you feel that data collected and published nationally give an 
accurate description .of the condition and progress of education 
in yo\ir state? 

Yes, very accurate description 

Moderately accurate 

Inaccurate — 

22. What are the reasons contributing to less-^than-desired levels of 
accuracy in describing the condition and progress of education in 
your state? Check all that apply. 

22.1 Formats utilized to provide comparability with 

other states distort true description - 

22.2 Information requested is too specific for an 

accurate description 

22.3 Information requested is too general for an 
acciurate description 

22. U Information is too inacc\irate 

22.5 Other (Specify): 

23. Uiat additional or substitute information would you want national 
agencies to collect to achieve your desired level of accuracy of 
describing the condition and progress of education in your state? 



; LEVELS COMMENTS 

KINDS OF DATA State LEA School 



23.1 EnroHment Projections 










23.2 Pirpil Characteristics 










23.3 Staff Levels 










23.^ Staff Characteristics 










23.5 Salary Levels 










23.6 lixpenditures by function 










23.7 ZxxamditureiJ by program 










23.6^ Achievement 










23.9 Riysical Facilities 










23.10 Federal Aid 










23.11 State and Local Revenues 










23.12 Others (Specify): 











17J+ 







[ . 



r y 



o 
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2U. What data should not he collected nationally? 



KINDS OF DATA 



LEVEIS 



COMMENTS 



School 



2l^.l Enrollment Projections 










24.2 Pupil Characteristics 










24.3 Staff Levels 










24.4 Staff Characteristics 










24.5 Salary 
Levels 










24.6 Expenditiires by Function 










24.7 Expenditures by Program 










24.8 Ach i e vement 










24.9 Physical 

Facllixies 










24.10 Federal 
Aid 










24.11 State and Local 
Revenues 










24.12 Other (Specify) : ‘ 











25 . Does the kind of information currently being collected contribute 
to an vinder standing of the condition and progress of education in 
the United States and its territories as a whole? 



Yes, very accurate description 
Moderately accurate 
Inacctirate 

COMMENTS : 
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26. What kinds of additional or substitute information do you think 
would contribute to a greater understanding of the condition 
emd progress of education in the country as a whole? 



KINDS OF DATA LEVELS COMMENTS 

State LEA School 



26*1 Enrollment Projections 










26.2 Pupil Characteristics 










2^.3 Staff Levels 










2 ^V^ Staff Characteristics 










to »3 Salary 
Levels 










26.6 Expenditures by Function 










2^7 Expenditxires by Program 










26.8 Achievement 










26.9 Physical 

Facilities 










2^.10 Federal 
Aid 










2^.11 State and Local 
Revenues 










26.12 Others (Si>ecify) : 











If you have additional comments on Relati'va Usefulness of Various 
National Sources of Educational Data, please make them here: 
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POSSIBLE LIMITATIONS ENCOUTrTERED IN GATHERING DATA 



Problems of Data Collections 



27. State and local agencies as producers of data have registered a 
munber of complaints about the collection procedures employed by 
national agencies. In order to pinpoint major problem areas several 
possible reasons for complaint are given below. Use the following 
code to express the extent to which the reasons listed apply to your 
situation (adding problem areas as rec^uired) and give examples of 
specific problems which you have experienced. 



Enter numbers as appropriate 0 not a problem 

1 rarely a source of problems 

2 minor soiurce of problems 

3 major source of problems 

Code Example of 

N\unber Specific Problems 

27.1 Duplication of data items on 
various sinrveys from national 

agencies and organizations 

27«2 Duplication of whole surveys 

27.3 Bequests for data not other- 
wise collected, i.c. new item 

27 *^ Need for data not established — 

27.5 Data instrument given to states 

without sufficient lead time 

27*6 Cost of data collection burden- 
some 

27 .7 Information does not lead to 

understanding of real issues 

27.8 Definitions of categories vague 

27 .9 Requests for data are untimely 

27.10 Other (Specify): 



28. How do you think the major problem areas you checked above can be 
resolved? 




SUPPORT OF DATA COLLECTION 



29. The burden of collecting data for the federal government is unevenly- 
distributed among states, school districts and schools within each 
state. How could the agencies bearing the greater b-urden for 
supplying data be most effectively helped if additional federal funds 
were made available to states and local districts for data 
collection? Please check one. , 



29.1 By spending funds on strenghthening state education 

departm.ent s' informations systems particularly in 
overburdened states 

29.2 By providing additional funds to local school dis- 

tricts included in survey samples 

29.3 Have data collected by field staff of national 

agencies or organizations 

29-^ Use only data regularly reported to state education 
agencies by the local education agency 

29.5 Other (Specify): 



30. What factors affect the quality of data reported to national 

agencies by state agencies? Indicate the three most important 
factors by ranking 1st, 2nd, 3rd. 

30il Who -pays for data collection 

30.2 Perceptions of who benefits from the data collected 

30.3 Size of staff available to meet all requests from 

all sources for data 

30. U Level of staff expertise 

30.5 The time allotted for collection of data, i.e. due 

dates 

30.6 Whether the state or its districts already collect 

the requested data 

30.7 Quality of data provided by LEA's to state agency 

30.8 Other (Specify): 
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31- V/liat factors affect the quality of data reported to national 

agencies from local education agencies and schools. Indicate the 
three most important factors by ranking 1st, 2nd, 3rd. 

31.1 V.ho pays for data ^llection 

31.2 Pei’CcipLions of vh . benefits from the data collected 

3d .3 Size of staff available to meet all requests from all 

sources for data _______ 

31. U Level of staff expertise ______ 

31.5 The time allotted for collection of data, i.e. d\ie 

dates 

31.6 Whether the requested data is routinely collected 

31.7 Other , specify) : 



If you have additional comments on Possible Limitations Encoiontered 
in Gathering Data, please make them here: 
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SUGGESTIONS FOR IMPROVEIffiNT OF EDUCATIONAL DATA SYSTEMS 



Several methods on how to improve the collection and availability 
of data bearing on educational policies and programs have been suggested. 
The methods include many different facets which are not mutually ex- 
clusive, for example: Who should finance data coi*. cl.ion? To what extent? 

Should standards be imposed? In the following set of questions the 
various suggested methods for improvement are broken down into their 
m^or elements. Please check (x) the statements you believe to be 
feasible and desirable. 

32. Voluntary vs, non-voluntary approach 

32.1 Continue with voluntary system similar to the 

one which now exists 

32.2 Federal data collection should be non-voluntary 

(similar to the U.S. Census) 

32.3 no opinion 

33* The costs of data collection should be funded 

33.1 totally by the federal governments 

33.2 partially (to cover the additional costs in- 

curred by meeting federal agencies' request 

for information) by the federal government 

33*3 by source other than the federiil go'''ern,ment 

(specify): 

33*^ no opinion ___ 

3U. The federal government should 

3^.1 fund data collection and impose standards 

3^.2 fund data collection and not impose standards 

3^.3 not fund data collection, but should impose 

standards 

34. U not fund data collection and not attempt to 

impose standards 

34.5 no opinion 



35 . The NationeJ. Center for Educational Statlatics of 

U.S. Office of Education should he expanded and 
strengthened with a capahility to 

35.1 directly collect data in the field and provide 

a comprehensive national educational data base 

35.2 collect data from state and local education 

agencies and provide a national educational 

data base 

35.3 collect directly, or from other a^enciea, and 

publish only the important information for 
which a demand exists , hut which cannot 
currently be supplied from any source in the 
necessary form . . . _ 

35.1+ disagree with idea that NCES should be involved 

with improvement scheme 

35.5 no opinion / 

36. A new biireau under the Depsurtment of Heedth, Education and 

Welfare should be established to 

36.1 collect and bring together for publication data 

which relates education to the other areas 
of socio-economic concerns 

36.2 provide a national educational data system 

36.3 do not agree with stiggestion for new agency 

under HEW 

36.4 no opinion 

If you have any additional comments on Suggestions for Improvement 
of Educational Data Systems, please make them here: 



Thank you for your assistance . Please place this questionnaire 
in the attached envelope and mail. If you have additioned comments 
or suggestions, feel free to include them on the oack of this page. 
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ADDITIONAL COMMENTS 



• ^ 
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Appendix B 



A LISTING 
OF 

WATIOWAL DATA SOURCES FOR EDUCATIQ :j 
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NCEA stands for National Catholic Education Association 
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Appendix C 



RECOMMENDATIONS & CURRENT STATUS 
OF KELLY COMt-IITTEE RECONE'IENDATIONS 



The Committee on Educational Finance Statistics 
(James A. Kelly, chairman) was appointed by 
the late James E. Allen, former U,S. Commissioner 
of Education. The Committee Report including 
nine specific recommendations for improving the 
statistical program of USOE was submitted to Dr. 
Allen in March, 1971. The nine recommendations, 
implementation plans of the National Center for 
Educatio'aal Statistics and cost estimates comprise 
this appendix section. 
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Recommendations of the Committee for Educational Finance Statistics and NCES Plans for Implementation 
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Appendix E 



MATERIALS RELATED TO THE CONFERENCE ON 
IMPROVING INFORMATION SYSTEMS FOR 
EDUCATIONAL POLICY M.\KING 



1. Conference participants 

2 . Agenda 

3. "Information Systems for Educational Policy 

Making: Micro-Economics of Elementary and 

Secondary Education" by Professor Jesse 
Burkhead, Maxwell Graduate School, Syracuse 
University 



T 



A Conference on 



IMPROVIWG IWFORMATTOW SySTEMS FOR EPtICATIOWAL 

POLICV mWG 



A part of a project conducted for ^ 

The President's Conanission on School Finance 

by the 

Policy Institute 

of the Syracuse University Research Corporation 
in cooperation with the 

Maxwell Graduate School of Citizenship & Public 
Affairs of Syracuse University 

at the 

Lake Meadou>6 Inn, Cazenov^a, H.V, 

June. 17th B 18th, 1971 

■ . ; 

' K 

i 

21 ); ''' 






221 








/ 

f 



*, 



y ■ 



t- 

f. 

r 

f 







• ••» * * ** ** «»»»»»«* » « 



LIST OF PAmClVAHTS 

Voticy JrutitLLtt S ^<kxw^iZ Sdiool 

Ralph K. Andrev - Policy Institute Research Assistant 
Stephen K. Bailey - Chairman, Policy Institute 
Roy Bohl - Director, SURC Urban and Regional Research 
Center 

Joel S. Berke - Director, Educational Finance and Governance 
Program 

Jesse Burkhead — Professor of Economics , Maxwell School 
Jerry Calderone - Policy Institute Research Assistant 
Kathleen A. DiTullio - Policy Institute Administrative Assistant 
Robert J. .Goettel - Project Director 

Beurrie L. Goldstein - Policy Institute Research Assistant 

Paul Irvin - Policy Institute Research Associate 

Michael Marlen - Research Associate , SURC Educational Policy 

Research Center 

Jerry Miner - Professor of Economics , Maxwell School 
Roger Parry - Research Assistant, School of Education 
Seymour Sacks - Professor of Economics , Maxirell School 
Ronald White - Policy Institute Research Assistant 

6 Commi66^on 

Richard Barr - Research Associate 
Norman Karsh - Staff Director 
Sigmund Sklar - Research Director 



Owt&ldz Con&uUanXi S entatLv&6 

Sam Bliss - Director, Educational Resource Management Center, 
Northern Arizona University 

Jean Flanigan — Assistant Director, Research Division, National 
Education Association 

Edvard Glassman — Educational Specialist, Office of Education 
Carol Hotoson - Chief, Elementary & Secondary Educational Surveys 
Bremch, Office of Education 

Euqene .McLoone - Professor of Economics & Education, University 

of Meiryland 

John Polley - Assistant Commissioner for Educational Fineuace & 
Management Service, New York State Educational 
Department 

John Btiglmeier - Director, Information Center for Education, 

New York State Education Department 
Charles Sullivan - Meaaxirement Research Corporation of Westing- 

house Learning 

John Wood - Office of Education 
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9:30 



10:15 

11:00 

11:15 

12:30 

2:00 

3:00 

3:15 



A6EWPA 

TliuMday June 17 

10:15 - iiJBLmE 

Stephen K. Bailey, Chairman 

mROVUCTJOI^S 

Joel S. Berke 

PRESItJEWTS COmiSSm OW SCHOOL 
FIWAWCE 

Norman Karsh 

WATIOWAL CE^^'ER FOR EVUCATW^AL 
STATISTICS 

^!rB . Carol J . Hohson 

11:00 - MEASURING FISCAL UEEV, CAPACITY, ANP 
EFFORT 

Robert J . Goettel 
11:15 - Coffee 

12:15 - MEASimm EVUCATJONAL WEEP 
Joel S. Berke 
•2:00 - Lunch 

3:00 - IfEASmm CURREffT RESOURCES - EXPENPITURES 6 
SERVICES 

Robert J. Goettel, Moderator 
Eugene Mcloone 

3:15 - Coffee 

U:15 - MEASURING FEPERAL AIP FLOWS 

Joel S. Berke, Moderator 
Seymour Sacks 

5:30 - Cocktails 

2l6 
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F^day June 18 

9:30 - 11:00 - MEASURING EVUCATIONAL IMPACT 

Robert J. Goettel, Moderator 
Jesse Btarkhead 

11:00 - 11:15 - Coffee 

11:15 - 12:15 - EMERGING AREAS OF CONCERN 

Joel S. Lerke, Moderator 
Jerry Miner 

12:30 - 2:00 - Danch 

2:00 - li:00 - UINWP 6 SUmR^ 
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Information Systems for Educational Policy Making 

Micro-Economics of Elementary 
and Secondary Education 



i 



Professor Jesse Burkhead 
Maxvell School 
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I. General Background 

Ten years ago Schultz, Becker and others were engaged in the 
"rediscovery of the human- agent" . This pioneering work, generally 
at the macro level, produced some interesting findings on the in- 
vestment value of education, on the contribution of training and 
education to gross output (education in a macro production fimction) , 
and introduced the concept of measuring educational outcomes in tenna 
of an improvement in discounted lifetime earnings. This literature 
undoubtedly contributed to a generalized shift in public attitudes 
towerd education. Our national Cold War response to Sputnick in 
1957 vas the National Defense Education Act of 1958 ; in the last 
decade, our response to all problems of unemployment i poverty, and 
racism has been: mC'Te resources must be devoted to education. 

The concern with the macro aspects of investment in education 
spa'imed an equivalent concern with micro-economic' aspects. Here the 
isB'iie is simply: how can educational outputs be maximized from a 

given volume of resource inputs. This approach reqxiires that the 
school be looked at as if it were a producing firm, engaged in economic 
optimizing in the same way that a business firm is engaged in opti- 
mizing net revenue. 

The micro-economics of education, sometimes called systems analysis 
and sometimes linked with program 'budgeting, and sometimes cast in 
terms of production functions or input-output relationships^ has been 
pursued by such economists as Benson, Levin, Katzman, Ribich, Burkhead- 
Fox-Holland and others. (The Coleman Report is not irrelevant to this 
type of research). The results, to date, have been most disappointing. 



In. all the empirical vork that has ."been done it has "been dis- 
covered that out-of -achool influences are far ipore important 
on educational outcomes than in-school influences . The socio-economic 
characteristics of the children count far more than anything that goes 
on in the classroom. To he sure, some teacher characteristics seem to 
he moderately significant (Benson, Levin, Biirkhead-Fox-IIolland) . The 
verbal skills of the teacher carry over into the verbal skills of 
students; more experienced teachers produce better test scores than 
inexperienced teachers . But none of the empirical vork has disoovered 
that smaller class size (vi thin the ranges investigated), newer buildlnss, 
increased expenditvires on the library, or on equipment, or on auxiliary 
personnel have any important effect on school outputs, where such outputs 
are measured in terms of test scores, drop-outs or continuing education. 

Nevertheless, there is on-going interest in approaching the micro- 
economics of education by way of program budgeting and there are know- 
ledgeable authorities who feel that additional experience will yield a 
better understanding of resource allocation patterns within schools and 
Mtnnng schools vlthln a specific school system (J. Alan Thomas, The 
Productive School) . 

Finally', the backgrounlfor an examination of the micro upects of 
education muit include reference to a growing feeling on the part of many 
contemporary critics that elementeuy amd secondary schools, with few 
exceptions, are the very antithesis of education. Miner has put the point 
well: 

Policy toward education as an industry cannot Ignore the role 
of the schools in fostering racism and stultifying intellectual 
end emotional growth. Without accepting in full the views of 
Kozol, Silherman, Kohl, Illich and others, those concerned with 
policy cannot look only nt the resources needed to attain equality 
in the performance of ischools or of pupils without regard to 
whether any of these performances are personally or socially 
destructive. . .If the production function in schools cannot he 
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altered to reduce their destructive effects to tolerable 
limits , greater emphasis on alternative educational ins- 
truments is called for. 

II. The natxire of the problem 

One way in which the micro-economics of education may he con- 
ceptualized is to start with a recognition that there is a vector of 
inputs, a vector of activities within the school and a vector of 
outputs : 




Each of these .yectors presents formidable conceptual and measurement 
problems and there are complex inter-actions among the elements within 
and between vectors . 

With no pretension at comprehensiveness, the following may be noted 
as some of the most difficult problems that are encountered; 

1. The inp\rt vector most encompass all real resource costs, such 
as teachers , administrators , bxxildlngs and supplies . But the price of 
inputs, as with teachers, and their salaries, may not adequately reflect 
quality variations . Moreover , perhaps the most significant input to 
the education industry is student time, and how is this to be valuedt 

j 

Student inputs are also conditioned by home and nei^borhood. How is 

I 

this to be taken into account in the input vector? (Burkhead-Fox-Holland 
treated SES as a "status variable" and thus made it the first input 
into the "production function.") 

1 2. The activity vector reflects the combinations of factors 

(student time, teacher tixne, equipment) that the school utilizes in order 
to conduct certain activities, such as specified numbers of arithmetic \ 
classes of specified size, and specified numbers of extra-curricular 
activities such as athletics, driver-education and the fla£-seQ.ute . 
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Unfortunately, no elementary or high school principal, has sufficient 
knovledge of marglncl. productivities to secure the least— cost com- 
bination of such factors. 

3 . The output vector presumably reflects the goals that the 
school has established for itself, or that society has imposed upon 
it. There are obviously multiple goals--no single output here— and 
therefore the economist traditionally proposes to cost out the goals 
and establish appropriate trade-offs among them. This could sweep 
all the important value Judgments under the rug. Who is to decide, 
and on vhat basis, that it is more important to raise the eighth 
grade lower quartile reading scores them the eight grade upper quartlle 
reading scores? Who shall decide that mentally retarded children shall 
have a class size that does not exceed four? Economists tlresomely 
warn that resources are limited, but there is no trade-off analysis 
that will eliminate the need for value Judgments that must be <mi 
non-econcmic grounds . 

Thus the output vector, in systems approach, comes to rest heavily 
on that which can be quantified — test scores and drop-outs. No cme has 
yet discovered how to measure the far more significant outputs of 
education (in-school and out-of-school) such as integrity, creativity, 
and a sensitivity to human relationships . 

III. Data r.egulrements for micro-economic suidysis of elementary and 

secondary education. 

In spite of the many formidable conceptual problems, and the 
listing in II is by no means complete, it may still, quite possibly, 
be desirable for USOE or state departments of education to encourage 
addltiona]. systems analysis linked with the budget. This cmst be 
established and administered, at the_ school district level, and dlsag- 
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gregated at least to the level of each individual school. Organi- 
zationally, there must he a central school district budget and 
evaluation staff that prepares the manual, defines the inputs, 
activities and outputs, and enlists the cooperation of school 
principals and teachers . The minimum data requireinents are as follows 



1. Inputs • 

01. Instructional costs (with teacher characteristics) 

02. Administrative costs 

03. Auxiliary personnel costs (guidance, librarians, etc.) 
OU. Materials and supplies 

03 - Buildings and grotmds. 

06. SES of pupils (possibly obtainable by annual question- 



naires on housing conditions or occupation of parents) . 



2. Activities 



01. Class size, to whatever degree of disaggregation seems 
appropriate . 



02. Extra-curricvilar activities 



03* Staff relationships (perb.ap3 an index of staff partici- 
pation, or an evaluation of the effectiveness of the 
principal) 



3. 



Outputs 

01. Test scores (verbal, quantitative) 

02. Dropouts 

03. Continuing education 

OU. Socialization (an index of vandalism)? 



It may be noted that test scores should be derived from the ^ame 






test administered; at successive grade levels, so that "value -addeq* 
can be estimated. This will require a different testing procedure than 
that now commonly employ in e;lementary and secondary education, where 
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tests axe used primarily for tracking and guidance counseling. 

IV. Possible outcomes 

1. If employed over a period of years, the foregoing type of 
systems analysis might contribute to better Judgments about costs and 
effectiveness of specific programs and thus serve up some numbers that 
would be helpful in educational policy making. At minimum, it would 
provide information on the costs of innovations. It should be noted, 
however, that where the SES characteristics of a school are changing 
rapidly, over-time analysis is virtually impossible. It may also 

be impossible in depressed areas where teacher turnover is (numeri- 
cally) 100 percent of ADA, or where teacher turnover is as high as 
25 percent during a given school year. It may also be impossible in 
schools that are undergoing major organizational transitions in terms 
of community participation and control, 

2. In relatively stable situations, systems may also contribute 
rinsig^ts on prox>er factor combinations — better information than we 
now have on dais size consequences , on the utilization of teacher 
aids, or on the utilization of auxiliary personnel. 

These >are modest outcomes , but may nevertheless be worth 
pursuing. Unfortunately, there are far too many gaps in our existing 
knowledge to be confident that systems analysis can make a major con- 
tribution. The biggest gap of all is the absence of a defined re- 
lationship between what is measurable and what is known about learning 
theory. There is no reason to suppose that learning is a linear 
function. Indeed, there is every reason to suppose that there are 
abundant thresholds and discontinuities. What is the importance of 
pre-school, Headstart type programs? Ai'e there crucial years in the 
acquisition of reading skills, such as the first grade or the fourth 



grade? Educational psychologlets have not yet provided any anawera 
and perhapa none are forthcoming. But until ayatema analyila i a linked 
with learning theory it will always hang at leant partially In mid-air. 

It is also possible that the "system" of education in any society 
is a seamless web that defies analytic treatment. Schools are eatablished 
to "educate" the .work force In the ckllla that the economy requires . 
Students are tented and credentialled in terms of these skills. In-school 
and out-of-school influences cannot be separated. We get what we deserve 
and the "efficient" use of educational resources may be a aubsidiary 
concern in a society as wasteful as ours . 
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